-- Logs begin at Fri 2022-06-24 06:21:55 UTC, end at Fri 2022-06-24 07:24:08 UTC. -- Jun 24 06:56:08.144621 dv-cinder-834822-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 06:56:08.152119 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 06:56:08.154115 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 06:56:08 2022] *** Jun 24 06:56:08.154115 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 06:56:08.154115 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 06:56:08.154115 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: nodename: dv-cinder-834822-5-iscsi Jun 24 06:56:08.154115 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: machine: x86_64 Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: clock source: unix Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: pcre jit disabled Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: detected number of CPU cores: 4 Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: current working directory: / Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: detected binary path: /usr/bin/uwsgi-core Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: your processes number limit is 47680 Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: your memory page size is 4096 bytes Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: detected max file descriptor number: 2048 Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: lock engine: pthread robust mutexes Jun 24 06:56:08.154432 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: thunder lock: enabled Jun 24 06:56:08.154974 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 06:56:08.154974 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 06:56:08.198326 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: Python main interpreter initialized at 0x55a9c5e1d9c0 Jun 24 06:56:08.198326 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: python threads support enabled Jun 24 06:56:08.198326 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: your server socket listen backlog is limited to 100 connections Jun 24 06:56:08.198326 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: your mercy for graceful operations on workers is 90 seconds Jun 24 06:56:08.198708 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 06:56:08.198781 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: *** Operational MODE: preforking *** Jun 24 06:56:08.199050 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: *** uWSGI is running in multiple interpreter mode *** Jun 24 06:56:08.199050 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: spawned uWSGI master process (pid: 80355) Jun 24 06:56:08.199269 dv-cinder-834822-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 24 06:56:08.200273 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: spawned uWSGI worker 1 (pid: 80365, cores: 1) Jun 24 06:56:08.200273 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: spawned uWSGI worker 2 (pid: 80366, cores: 1) Jun 24 06:56:08.200435 dv-cinder-834822-5-iscsi devstack@keystone.service[80355]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 06:56:13.519677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 06:56:13.519677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: from cryptography.utils import int_from_bytes Jun 24 06:56:13.520511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 06:56:13.520511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: from cryptography.utils import int_from_bytes Jun 24 06:56:13.522206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 06:56:13.522206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: from cryptography.utils import int_from_bytes Jun 24 06:56:13.522695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 06:56:13.522695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: from cryptography.utils import int_from_bytes Jun 24 06:56:13.567802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 06:56:13.567991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 06:56:13.568163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] command line args: [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 06:56:13.568455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 06:56:13.568584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 06:56:13.568673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ================================================================================ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 06:56:13.568823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 06:56:13.568963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] admin_token = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.569043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] command line args: [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 06:56:13.569123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] config_dir = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.569269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 06:56:13.569370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.569449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] config_source = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.569509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ================================================================================ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 06:56:13.569573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] debug = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.569638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] admin_token = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.569777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] config_dir = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] config_source = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] debug = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.570995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_config_append = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_dir = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.571976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_config_append = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_dir = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.572828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.573958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.574922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] publish_errors = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.575919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] publish_errors = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.576939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] standard_threads = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] standard_threads = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] use_journal = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.577913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] use_json = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] use_stderr = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] use_syslog = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] use_journal = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] use_json = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.578770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] use_stderr = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.578928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] use_syslog = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.579142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 06:56:13.579386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.579951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.580944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.581875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.582959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.583953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.584964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.585867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.586937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587767 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.587948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.588928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.589984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.590899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.591951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.592950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.593955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.594921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.595828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.596945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.597944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.598872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599336 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.599963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.600948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601180 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.601881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.602026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.602102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.602263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.602339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.602497 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.602895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.external = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.603957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.password = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.external = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.token = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.604852 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.password = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.token = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605785 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.605947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.606963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.607911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.608874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609148 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.609874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.610995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.611958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.612916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.613945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.614986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.615930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.616942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.617907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.618995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.619946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.620997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.621928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622065 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.622988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623228 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.623950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.624967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.625886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.626972 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.627990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.628917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.629852 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.630928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631462 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.631954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.632890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.633815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.634976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.635922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] role.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] role.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.636926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] role.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] role.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.637873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638598 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.638986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.639964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640688 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.640832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.641961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.642975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.643097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.643220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.643342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.643472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.643595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.643718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.644949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.645994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646620 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.646982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.647998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648555 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.648956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.649844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650319 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.650942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651478 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.651965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.652893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.653906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 06:56:13.653985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 06:56:13.654124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 06:56:13.683975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.684199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.684409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.684492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.684690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.684900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.692921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.693423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.722630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.722847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.724224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.724617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.866870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.870231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.914637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.914767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.915879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.916128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.977110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.977358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.977500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.977900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.977989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:13.978682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.002851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.003915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.004041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.004170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.004545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.004765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.015057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.015693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.027654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.027894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.028136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.028340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.028533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.028765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.028952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.029091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.029164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.029422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.029638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.029862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.030061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.030275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 06:56:14.046545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.046761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 06:56:14.047092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.047264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 06:56:14.047489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.047613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.047682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 06:56:14.047763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.048049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.048173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.048261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 06:56:14.048340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.048505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.048770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.049020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.049240 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.059051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.059321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.059581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.059876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.060067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.060329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.060593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.060866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.068109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.069135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.071337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.071646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.071941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.072220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.072454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.072600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.072708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.072799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.073901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.074016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.074112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.074311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.074571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.074824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.075073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.100277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.101872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.102142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.104615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.106511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.106791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.107762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.108177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.108452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.112047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.112434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.112718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.115648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.115943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.119999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.120277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.120400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.120704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.120979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.121256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.121520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.121782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.122015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.122302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.124755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.125040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.125322 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.125584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.125853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.126118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.126380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.126642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.140840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.141108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.145326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.145595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.145735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.149277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.149693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.150212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.153878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.154274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.154661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.158255 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.159272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.161893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.162181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.162464 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.162737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.162861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.163010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.163284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.166608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.166844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.167126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.167404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.167685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.168007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.182193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.182432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.182730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.182995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.186976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.187258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.187532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.187803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.190811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.192513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.192762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.195651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.196010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.196300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.196647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.196942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.197220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.197388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.197686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.200898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.201173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.201450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.201731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.202008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.210297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.210568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.210849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.211125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.212753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.213039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.213327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.215624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.215931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.216220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.216501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.218112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.218403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.218690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.231285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.234570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.236997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.237858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.239557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.240296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.241204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.241480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.241776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.243572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.245316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.246952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.247228 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.247509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.249083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.250671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.253889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.254173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.254554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.254825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.254950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.256463 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.259717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.260032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.260425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.260703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.263888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.264191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.264467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.269770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.270053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.270327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.272279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.272546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.272814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.273081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.273344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.273711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.273984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.274256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.274549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.274812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.275071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.275336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.275593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.275878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.278141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 06:56:14.278414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.278690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.278962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.279229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.279622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.279924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.280192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.280470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.280722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.281000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.281276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.281542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.281808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 06:56:14.313243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a9c5e1d9c0 pid: 80365 (default app) Jun 24 06:56:14.316689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644d12-3f21-470d-9fa8-c198c79aa479 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:14.316985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644d12-3f21-470d-9fa8-c198c79aa479 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:14.317262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71644d12-3f21-470d-9fa8-c198c79aa479 None None] PATH_INFO: `/v3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:14.319507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a9c5e1d9c0 pid: 80366 (default app) Jun 24 06:56:14.321499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Jun 24 06:56:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:22.001157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:22.002088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:22.002088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:22.009263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:22.018184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:22.018611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:22.018747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:22.091238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: INFO dbcounter [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] Registered counter for database keystone Jun 24 06:56:22.115478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 06:56:22.122794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writer thread running {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 06:56:22.298885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG passlib.handlers.bcrypt [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80365) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 06:56:22.299290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG passlib.handlers.bcrypt [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80365) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 06:56:22.354853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:22.356468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:22.487576 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 06:56:22.651199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:22.726401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: INFO dbcounter [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] Registered counter for database keystone Jun 24 06:56:22.747670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG oslo_db.sqlalchemy.engines [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 06:56:22.755706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writer thread running {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 06:56:22.882707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a3e46-23e0-4310-a06d-d0f71ac7b319 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:22.888184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:22.888852 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:22.889135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:22.889412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:22.898521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:22.949893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 06:56:22.950164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c83c12-87fe-4299-8b6e-257f2cf21a5a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:22.960649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Jun 24 06:56:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 06:56:22.970380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:22.994309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbc52-5e9d-4258-be0a-dcea41638b03 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:23.000838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:23.001985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:23.002273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:23.002549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] PATH_INFO: `/v3/projects/380a960ee385491dbc55afab2693ac72` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:23.006898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] RBAC: Authorizing `identity:get_project(project_id=380a960ee385491dbc55afab2693ac72)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:23.056781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 06:56:23.057413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5cd7d-ed97-4c1d-b130-f0a8313548dc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:23.061778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Jun 24 06:56:22 2022] GET /identity/v3/projects/380a960ee385491dbc55afab2693ac72 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:25.053099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0cfb-d90f-42c0-87b1-36d9db346d26 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:25.053976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0cfb-d90f-42c0-87b1-36d9db346d26 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:25.053976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0cfb-d90f-42c0-87b1-36d9db346d26 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:25.058907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:25.065461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:25.065897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:25.066031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:25.093737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:25.095291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:25.105781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 06:56:25.128991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0cfb-d90f-42c0-87b1-36d9db346d26 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:25.150687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0cfb-d90f-42c0-87b1-36d9db346d26 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:25.156330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74763-372d-447b-85ba-3bb685d7a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:25.156974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74763-372d-447b-85ba-3bb685d7a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:25.157256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74763-372d-447b-85ba-3bb685d7a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:25.157529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74763-372d-447b-85ba-3bb685d7a4ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:25.165338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74763-372d-447b-85ba-3bb685d7a4ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:25.167132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74763-372d-447b-85ba-3bb685d7a4ce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:25.176066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Jun 24 06:56:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 06:56:25.181426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:25.190667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b733-a17a-4f90-a97e-cf9e937a5b7b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:25.195533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6cdd6-b294-469f-83eb-7255d9fd5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:25.196434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6cdd6-b294-469f-83eb-7255d9fd5570 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:25.196717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6cdd6-b294-469f-83eb-7255d9fd5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:25.196992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6cdd6-b294-469f-83eb-7255d9fd5570 admin admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:25.198441 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6cdd6-b294-469f-83eb-7255d9fd5570 admin admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:25.200304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6cdd6-b294-469f-83eb-7255d9fd5570 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:25.201869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Jun 24 06:56:25 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:27.258729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c31c9-ce99-435c-9294-f669313e54d3 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.259268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c31c9-ce99-435c-9294-f669313e54d3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.259268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c31c9-ce99-435c-9294-f669313e54d3 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.260732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:27.265997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.266417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.266518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.279247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183ab6-ab08-468f-8253-f19edf87ac64 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.279529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183ab6-ab08-468f-8253-f19edf87ac64 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.279804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183ab6-ab08-468f-8253-f19edf87ac64 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.281125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:27.284214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:27.285413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:27.286020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.286308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.286584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.325411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG passlib.handlers.bcrypt [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80366) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 06:56:27.325819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG passlib.handlers.bcrypt [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80366) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 06:56:27.370904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:27.372409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:27.373643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:27.395770 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:27.419792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:27.471618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:27.500457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e13bc6-c857-4736-9c38-b7607c002049 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:27.500827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:27.537690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:27.538428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.538713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.538990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.551516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:27.563111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:27.563994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:27.564814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:27.570102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:27.606902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fadff-ce3b-429b-9aa2-96d860ed293f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:27.609245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:27.644083 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:27.644986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.645269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.645542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.651596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:27.671787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab95a52-7e14-43ab-968e-75735a027a07 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:27.706946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:27.707619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.707929 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.708207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.708968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:27.709281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:27.710695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:27.712314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:27.713853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:27.722583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:27.728561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:27.815112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:27.820673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:27.824249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:27.830611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694830c-b059-44fb-889b-389c7a867479 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:27.864670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:27.865554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.865837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.866107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.867350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:27.868863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:27.874788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:27 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:27.875724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:27.890124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:27.919219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638597c-5d15-4e34-b158-b46ddfd5efaa None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:27.954520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:27.955310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:27.955586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:27.955874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:27.973261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96e0c-afd0-4f70-97c5-e83629a5e132 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:27.976110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:27.978017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:56:27.999684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:28.000672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:28.007077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:56:28.007077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:56:28.007077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:56:28.007077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:28.007077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:56:28.007429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:28.011591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:28.012456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:28.012735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:28.013005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:28.014289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:28.015748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:28.017435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:28.023042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:28.066541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:28.104183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:28.110754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a556a7f-400b-459c-9d35-532cdc18e55f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:28.124415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157d24-3f05-4edc-aebe-e029f745e8cb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:28.143480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:28.144452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:28.144739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:28.145018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:28.145773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:28.146076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:28.147475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e88b7-5927-4b72-a4c0-e9d333fe0bcb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:28.157190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:28.157847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:28.158128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:28.158400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:28.159234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.domain.id=default, user.id=f51e7a8fc6624717bbfc71dfc519fca3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:28.159544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:28.161005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b2fe1-9af0-4de4-b169-f4ff024bb84d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:28.164356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:28.167965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Jun 24 06:56:28 2022] GET /identity/v3/role_assignments?user.id=f51e7a8fc6624717bbfc71dfc519fca3&scope.domain.id=default&role.id=c55009d9dd08464ebde7f96db3459dea => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:30.517187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945979fc-cbfd-412c-b1c3-14370efa26d3 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.517698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945979fc-cbfd-412c-b1c3-14370efa26d3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.517802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945979fc-cbfd-412c-b1c3-14370efa26d3 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.519342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:30.524977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a55c-1c0c-4580-b61c-157ffdb80d75 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.525425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a55c-1c0c-4580-b61c-157ffdb80d75 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.525596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a55c-1c0c-4580-b61c-157ffdb80d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.552867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e3b0a55c-1c0c-4580-b61c-157ffdb80d75 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:30.554069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e3b0a55c-1c0c-4580-b61c-157ffdb80d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:30.572958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2967268-6c37-4485-85e5-9eab7bb2b329 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.573243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2967268-6c37-4485-85e5-9eab7bb2b329 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.573516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2967268-6c37-4485-85e5-9eab7bb2b329 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.575102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:30.595467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.595770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.596054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.629780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:30.630902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:30.658217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:30.659803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4169c6-23dd-4eed-a168-04d882f8b081 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.660302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4169c6-23dd-4eed-a168-04d882f8b081 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.660850 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4169c6-23dd-4eed-a168-04d882f8b081 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.662277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:30.669215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.669685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.670102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.699147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:30.700518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:30.780328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 14/26] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:30.781246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:30.796227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:30.839446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 06:56:30.842479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:30.923516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f917aca-fa21-4231-a2d4-bfb6952727ed None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:30.957616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:30.968431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:30.969244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:30.969590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:30.969866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:30.993410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:30.994900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:56:31.028912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:31.029771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:31.030538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:56:31.030538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:56:31.030538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:56:31.030538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:31.043453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:31.044399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.058661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04154e0e-8367-4c90-9e47-69bb5f029414 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.094937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.095663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.099868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.099868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.099868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:31.099868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.153675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:31.201893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81165-7a3c-4e8d-a50f-131da4867077 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.233416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 14/29] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jun 24 06:56:30 2022] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:31.234406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.246702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78717178-692b-4368-a3d4-a2ccc641bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.247518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78717178-692b-4368-a3d4-a2ccc641bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.247795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78717178-692b-4368-a3d4-a2ccc641bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.248115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78717178-692b-4368-a3d4-a2ccc641bcd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.280237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78717178-692b-4368-a3d4-a2ccc641bcd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-78717178-692b-4368-a3d4-a2ccc641bcd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:31.288146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:31.288968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:31.289757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:31.291210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c019-7009-450e-ae71-85a9f892f870 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.291210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c019-7009-450e-ae71-85a9f892f870 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.291210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c019-7009-450e-ae71-85a9f892f870 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.301081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 17/31] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:31.301948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c019-7009-450e-ae71-85a9f892f870 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.362608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344cb5-45ba-41b3-a8e2-ad6dd8c4326d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.371915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:31.404496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.405199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.405488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.405767 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.406839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:31.407152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:31.408751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba3ea-8005-4e33-a8d5-7c1db27de910 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.423489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 15/32] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:31.425079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.425953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.426383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.447372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:31.449576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:31.525526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c019-7009-450e-ae71-85a9f892f870 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.538868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 16/33] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:31.539971 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.555658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:31.589869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.590550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.590831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.591104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.591977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:31.592289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:31.593707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.607558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 18/34] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:31.608524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.660595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:31.668283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84038458-b023-4691-bbb4-b4404d58c8f3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.713068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.713747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.714035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.714312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.715453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:31.717712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.733567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07541dee-3466-4fd3-927b-996e697f126c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.756580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 17/35] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:56:31 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:31.757526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.792713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a548-55c4-4154-8721-b57fb151d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.793558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a548-55c4-4154-8721-b57fb151d8b5 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.793888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a548-55c4-4154-8721-b57fb151d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.794264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a548-55c4-4154-8721-b57fb151d8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.795112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73a548-55c4-4154-8721-b57fb151d8b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:31.796753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73a548-55c4-4154-8721-b57fb151d8b5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.882725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066a1a-17ad-4337-8f95-2947fc4aa00a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:31.921057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d03ee-b808-472b-8ce8-da298757b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:31.922016 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d03ee-b808-472b-8ce8-da298757b30b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.922308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d03ee-b808-472b-8ce8-da298757b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.922589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d03ee-b808-472b-8ce8-da298757b30b None admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.924147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d03ee-b808-472b-8ce8-da298757b30b None admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:31.925683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d03ee-b808-472b-8ce8-da298757b30b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:31.927947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 18/36] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:31 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:31.929205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa607ee-c898-4650-9128-94f94f2708ad None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.929496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa607ee-c898-4650-9128-94f94f2708ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.929777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa607ee-c898-4650-9128-94f94f2708ad None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:31.931307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 19/37] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:31.932987 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa607ee-c898-4650-9128-94f94f2708ad None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:31.958664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:31.985433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 19/38] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jun 24 06:56:31 2022] POST /identity/v3/roles => generated 225 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:31.987061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:31.987360 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:31.987641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.009471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:32.011518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:32.050049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:32.087177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa607ee-c898-4650-9128-94f94f2708ad None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:32.108282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 20/39] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:32.128494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:32.129705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.129992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.130270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.131175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:32.131543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:32.133095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:32.139760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 20/40] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:32.142764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:32.255915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:32.265194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c3543-ec93-4bfc-a6b6-988c1a28dd0a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:32.271358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9f28-5b1d-4eba-835e-64e16541b247 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:32.299368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ca76a-a6af-4d80-a7a3-8ab79c930849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:32.300126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca76a-a6af-4d80-a7a3-8ab79c930849 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.300352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca76a-a6af-4d80-a7a3-8ab79c930849 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.300624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca76a-a6af-4d80-a7a3-8ab79c930849 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.301369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ca76a-a6af-4d80-a7a3-8ab79c930849 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:32.302878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ca76a-a6af-4d80-a7a3-8ab79c930849 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:32.303366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:32.304275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.304557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.304862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] PATH_INFO: `/v3/domains/default/users/f51e7a8fc6624717bbfc71dfc519fca3/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.306892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f51e7a8fc6624717bbfc71dfc519fca3, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:32.308370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:32.315856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jun 24 06:56:32 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:56:32.317155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0403c7-97b4-4dab-bd4f-56c4f91948b1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.317450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0403c7-97b4-4dab-bd4f-56c4f91948b1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.317970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0403c7-97b4-4dab-bd4f-56c4f91948b1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.319223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 22/42] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:32.325022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Jun 24 06:56:32 2022] PUT /identity/v3/domains/default/users/f51e7a8fc6624717bbfc71dfc519fca3/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:56:32.326952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.327244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.327526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.465673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:32.466935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:32.501813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:32.548395 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 23/44] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:32.571464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:32.673219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665c5c-4909-49ab-8887-82e7ffefbd28 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:32.708557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc1d61-694f-4464-b690-05b1cc9c62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:32.709361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1d61-694f-4464-b690-05b1cc9c62d0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.709641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1d61-694f-4464-b690-05b1cc9c62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.709912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1d61-694f-4464-b690-05b1cc9c62d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.711176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc1d61-694f-4464-b690-05b1cc9c62d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:32.712785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc1d61-694f-4464-b690-05b1cc9c62d0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:32.714579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:32.720193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:32.827834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418720-fe76-408d-a581-f4e4278cfb9d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:32.865012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d745ed0-9a9c-43a0-ba3e-335157120e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:32.865681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745ed0-9a9c-43a0-ba3e-335157120e3b None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:32.865960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745ed0-9a9c-43a0-ba3e-335157120e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:32.866233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745ed0-9a9c-43a0-ba3e-335157120e3b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:32.866948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d745ed0-9a9c-43a0-ba3e-335157120e3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:32.868474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d745ed0-9a9c-43a0-ba3e-335157120e3b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:32.896277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:56:32 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:34.348451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cdd0-6ea1-49e7-93d3-39ad9a4913b7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.349008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cdd0-6ea1-49e7-93d3-39ad9a4913b7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.349008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cdd0-6ea1-49e7-93d3-39ad9a4913b7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.350360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:34.356109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.356554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.356646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.374108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:34.375297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:34.378351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:34.446792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:34.469521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cdd0-6ea1-49e7-93d3-39ad9a4913b7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:34.486098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:34.574759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cdd0-6ea1-49e7-93d3-39ad9a4913b7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:34.609819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:34.610550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.610835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.611111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.623292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:34.632292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:34.633169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:34.634082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 24/49] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:34.639497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:34.743444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98037f47-d842-4f88-8fe5-e8c365b715ad None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:34.779660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:34.780372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.780657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.780936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.781700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:34.781991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:34.783401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105a4db-0fb9-4f61-8e12-2823da32bcf4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:34.792105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:34.797820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:34.866241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7751f-156c-4eea-8137-ba03094a7bfb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.866417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7751f-156c-4eea-8137-ba03094a7bfb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.866726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7751f-156c-4eea-8137-ba03094a7bfb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.868394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 27/51] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:34.870825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:34.873056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.873377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.873655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.880045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:34.893222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:34.894405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:34.903207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6663fb-da81-46c1-953d-4d0ae0d4d77a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:34.936591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:34.937474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:34.937753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:34.938029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:34.939249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:34.940768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:34.942407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:34 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:34.947914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:34.959335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 28/53] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:34.982689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:35.049403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8f1d5-104d-41cd-95f4-7985fd759899 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:35.082705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44172-998c-4299-b732-1b3f4e857ebe None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:35.082917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:35.083718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:35.084042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:35.084321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:35.085572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:35.087119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:35.088785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 26/54] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:35.094410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:35.105357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:35.113798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:35.121591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:35.122365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:35.122721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:35.123079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:35.124484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:35.126304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:35.130416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:35.133465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:35.206824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e84d6-fa31-4d63-bae8-9b0b3c151e22 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:35.244313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36b876-933c-4785-8898-19de3e62eaf9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:35.254042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:35.254713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:35.255005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:35.255278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:35.256163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.domain.id=default, user.id=f51e7a8fc6624717bbfc71dfc519fca3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:35.256479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:35.257957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e950a4-8c14-4b2f-99a5-55e927d2a467 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:35.266264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Jun 24 06:56:35 2022] GET /identity/v3/role_assignments?user.id=f51e7a8fc6624717bbfc71dfc519fca3&scope.domain.id=default&role.id=c55009d9dd08464ebde7f96db3459dea => generated 530 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:35.278442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad38f-b211-40e3-90c0-ce50c8758b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:35.279134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad38f-b211-40e3-90c0-ce50c8758b21 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:35.279414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad38f-b211-40e3-90c0-ce50c8758b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:35.279687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad38f-b211-40e3-90c0-ce50c8758b21 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:35.280457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ad38f-b211-40e3-90c0-ce50c8758b21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:35.281940 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ad38f-b211-40e3-90c0-ce50c8758b21 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:35.309796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Jun 24 06:56:35 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:56:37.325526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a965d-e840-4d5e-9d77-941940d7ad67 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:37.326072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a965d-e840-4d5e-9d77-941940d7ad67 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:37.326072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a965d-e840-4d5e-9d77-941940d7ad67 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:37.327480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:37.333755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:37.334451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:37.334645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:37.353039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:37.354232 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:37.402557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:37.424304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:37.449282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a965d-e840-4d5e-9d77-941940d7ad67 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:37.642031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:37.673388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a965d-e840-4d5e-9d77-941940d7ad67 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:37.709014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9947-c498-45b0-bf36-118b525ff483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:37.709808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9947-c498-45b0-bf36-118b525ff483 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:37.710095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9947-c498-45b0-bf36-118b525ff483 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:37.710381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9947-c498-45b0-bf36-118b525ff483 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:37.711722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9947-c498-45b0-bf36-118b525ff483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:37.713219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9947-c498-45b0-bf36-118b525ff483 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:37.714857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:37.723788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:37.835378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f4fa3-2fe4-48be-a4b6-2b13cb55b491 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:37.877247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab944-f86f-4cd0-9bad-2401def0ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:37.877921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab944-f86f-4cd0-9bad-2401def0ccb2 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:37.878206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab944-f86f-4cd0-9bad-2401def0ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:37.878492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab944-f86f-4cd0-9bad-2401def0ccb2 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:37.879210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab944-f86f-4cd0-9bad-2401def0ccb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:37.880692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab944-f86f-4cd0-9bad-2401def0ccb2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:37.909081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:56:37 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:40.906822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37007ed-88ec-4d9b-bc28-62f0be45425a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:40.907709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37007ed-88ec-4d9b-bc28-62f0be45425a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:40.908158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37007ed-88ec-4d9b-bc28-62f0be45425a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:40.909904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:40.915437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c5d0-c486-4e4e-acbe-755cc89ad90f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:40.916216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c5d0-c486-4e4e-acbe-755cc89ad90f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:40.916654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c5d0-c486-4e4e-acbe-755cc89ad90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:40.940841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dc09c5d0-c486-4e4e-acbe-755cc89ad90f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:40.942037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dc09c5d0-c486-4e4e-acbe-755cc89ad90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:40.972335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.010850 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 33/63] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:41.042066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37007ed-88ec-4d9b-bc28-62f0be45425a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.091403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc119a9-bedb-4dea-8195-804a654f4462 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.092136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc119a9-bedb-4dea-8195-804a654f4462 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.092615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc119a9-bedb-4dea-8195-804a654f4462 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.094210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 34/64] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:41.099465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b53c-b9e1-47ac-bf88-e58b4480369e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.099752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b53c-b9e1-47ac-bf88-e58b4480369e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.100369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b53c-b9e1-47ac-bf88-e58b4480369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.127795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2d89b53c-b9e1-47ac-bf88-e58b4480369e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:41.129348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2d89b53c-b9e1-47ac-bf88-e58b4480369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:41.170059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37007ed-88ec-4d9b-bc28-62f0be45425a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.204652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba6123-c447-416c-b4d2-ddfe051f3ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.205699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6123-c447-416c-b4d2-ddfe051f3ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.206122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6123-c447-416c-b4d2-ddfe051f3ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.206533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6123-c447-416c-b4d2-ddfe051f3ea3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.217402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba6123-c447-416c-b4d2-ddfe051f3ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:41.224203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-23ba6123-c447-416c-b4d2-ddfe051f3ea3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:41.229699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:41.230780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:41.231755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:41.233838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 31/65] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:41.240092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c93b5f-c2dc-4df1-bf5b-f9b362f92f58 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.240687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c93b5f-c2dc-4df1-bf5b-f9b362f92f58 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.241133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c93b5f-c2dc-4df1-bf5b-f9b362f92f58 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.242655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 32/66] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:41.243664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c93b5f-c2dc-4df1-bf5b-f9b362f92f58 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.262038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:41.263473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.263830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.264207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.281806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:41.282989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:41.354828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 36/68] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:41.358000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c93b5f-c2dc-4df1-bf5b-f9b362f92f58 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.364009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.394390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.395508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.396030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.396550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.397602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:41.398131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:41.399871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:41.413105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 33/69] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:41.414372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.417921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.482802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.494923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9462c3-7ab8-41ab-8c52-e99c1b88791c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.525259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a3bb2-4f02-46f1-a896-a6e3b05a22a5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.531575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.532650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.533086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.533492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.544933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:41.553876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:41.554729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:41.555560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:41.557655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 37/70] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:41.558669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.563664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.564646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.565031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.565409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.577013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:41.585485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:41.586431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:41.587168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 34/71] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:41.587774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.659671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.672120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f07059-a83c-45e6-afd0-c033bfc868a2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.699030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886dbc0-ed4c-4c62-a882-98950daa6dba None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.709265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.710006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.710293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.710566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.724429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.725112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:41.726391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:41.728643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 38/72] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:41.729419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.738546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.739244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.739604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.739982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.740755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:41.741072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:41.742486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d408c29-bd4c-42ef-9c8f-a663209a7971 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:41.750610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 35/73] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:41.751823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9788-1fdc-4d16-9782-19e0eb7cf519 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.752151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9788-1fdc-4d16-9782-19e0eb7cf519 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.752431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f9788-1fdc-4d16-9782-19e0eb7cf519 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.753843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 36/74] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:41.755115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd93be-593a-4319-b621-51c4a3950c2a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.755115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd93be-593a-4319-b621-51c4a3950c2a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.755267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd93be-593a-4319-b621-51c4a3950c2a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.756515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 37/75] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:41.760123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd93be-593a-4319-b621-51c4a3950c2a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.829338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3606661-3c3c-4b9c-ab39-0798929f2276 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.860868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd93be-593a-4319-b621-51c4a3950c2a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:41.862776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.864202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.864493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.864776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.865549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:41.865858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:41.867264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:41.877572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 39/76] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:41.878264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:41.888911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.899180 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b654-161e-4ecf-babd-0de4ba1003a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:41.899831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b654-161e-4ecf-babd-0de4ba1003a9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:41.900144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b654-161e-4ecf-babd-0de4ba1003a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:41.900421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b654-161e-4ecf-babd-0de4ba1003a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:41.952187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:41.968317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2b654-161e-4ecf-babd-0de4ba1003a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:41.969874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2b654-161e-4ecf-babd-0de4ba1003a9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:41.978172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105cea-2fbc-4af5-9bfe-18bc88abca87 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.011063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7cf96-e514-46ad-a370-8a863e03785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.011872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7cf96-e514-46ad-a370-8a863e03785c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.012191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7cf96-e514-46ad-a370-8a863e03785c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.012467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7cf96-e514-46ad-a370-8a863e03785c None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.013665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7cf96-e514-46ad-a370-8a863e03785c None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.015127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7cf96-e514-46ad-a370-8a863e03785c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.017011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:42.018077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.018369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.018646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.036200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:42.037391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:42.066042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 38/78] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:42.067501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.067797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.068104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.084603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:42.085809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:42.101562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:42.102431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.110361 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.154752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 39/80] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:42.160835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.176357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.203421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a147-e733-48f6-871c-f7598adcaf29 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.237664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.238557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.238840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.239117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.240344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.241827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.243526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:42.248190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.259055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec792b-a97a-4b90-9821-7228f4757051 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.292026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.292677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.292959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.293233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.318550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.343953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b68a4-bf8e-45d6-bb9a-b80db123f4c0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.361211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.362703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.377558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.378684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.379463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.379736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.380064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.381382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.382822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.384624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:42.385380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.469346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 40/83] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:42.470221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.486034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74593d9-c721-4b91-b207-01d2515d28b5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.520307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.521111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.521402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.521674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.531751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:42.539594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:42.540494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:42.541230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 44/84] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:42.542694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.545207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.568351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee36a6-5732-40f7-b045-9f9bd72fc7bb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.582877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.604091 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.604904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.605192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.605471 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.606665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.608164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.609804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 41/85] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:42.610592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.643203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284ba90-9705-40d0-b3e4-d2c7b0880904 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.676446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.677090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.677367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.677644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.708594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c77877-f5b2-4771-90c3-2aa487294386 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.743626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.744314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.744488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.744620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.744885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.745725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=987e32a36dc249e0be2146ea2ea7edc7) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:42.745964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.746051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.747468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.747822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.753920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 42/86] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/role_assignments?user.id=987e32a36dc249e0be2146ea2ea7edc7&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:42.754772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.819587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:42.862052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 45/87] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:42.867886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.882026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1efc6-1aba-4af6-bd38-b31a4ad01bc5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.927090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:42.928163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:42.928757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:42.929057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:42.930728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:42.932823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:42.939649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 43/88] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:42.939649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:42.974703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc056-2b50-4820-9512-194831b2d7c0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:42.976445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.015158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.015884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.016167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.016449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.018008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:43.018329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.019739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.031874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 46/89] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:43.031874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:43.067385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e9be1-8d9b-47f6-979e-21da133554ff None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.082911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.107317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.108086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.108375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.109009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.109532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.111096 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.131342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31b12-d118-4170-8c41-b19bf05f5bcb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.139073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 44/90] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:56:42 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:43.140004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:43.185636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.186912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.187394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.187883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.189396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.191683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.193811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 47/91] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:43.195413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:43.242672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.275815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c03d2-1fbe-4b54-9e6e-13f7af433ab6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.316932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.317837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.318254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.318664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.319690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] RBAC: Adding query filter params (role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=987e32a36dc249e0be2146ea2ea7edc7) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:43.320220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.321717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.329211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/role_assignments?user.id=987e32a36dc249e0be2146ea2ea7edc7&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:43.329844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:43.342979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a49600-15e5-4bd3-81e8-91141a4e4b67 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.379080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.383034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.387277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.387648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.389319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.391878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.395031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.395499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 48/93] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:43.401319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:43.459547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06ef4e-03cd-4c73-a3bf-9812a704eceb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.500288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.501064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.501350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.501627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.502485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=f51e7a8fc6624717bbfc71dfc519fca3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:43.502798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.504434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.511263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 46/94] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/role_assignments?user.id=f51e7a8fc6624717bbfc71dfc519fca3&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:43.514439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.518586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785e1c-fbe6-481c-83be-915ff99fa3a8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.559356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.560059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.560347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.560624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.638920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.640350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.742755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.746448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 49/95] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:43.751803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:43.871236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:43.875097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b517-fe13-4b05-8fbd-e5d1f269d72c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:43.942493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e1dc7-d7e7-4270-832b-c23a06457583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:43.943299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e1dc7-d7e7-4270-832b-c23a06457583 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:43.943581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e1dc7-d7e7-4270-832b-c23a06457583 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:43.943871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e1dc7-d7e7-4270-832b-c23a06457583 None admin] PATH_INFO: `/v3/projects/af45de0e62764411b928277998d10f74` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:43.948765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e1dc7-d7e7-4270-832b-c23a06457583 None admin] RBAC: Authorizing `identity:get_project(project_id=af45de0e62764411b928277998d10f74)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:43.950253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e1dc7-d7e7-4270-832b-c23a06457583 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:43.952053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 47/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/projects/af45de0e62764411b928277998d10f74 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:43.958011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:44.099619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095dfe6-7797-4be8-b467-114991876146 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:44.138568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:44.139235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:44.139520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:44.139797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:44.140675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=af45de0e62764411b928277998d10f74, user.id=987e32a36dc249e0be2146ea2ea7edc7) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:44.140989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:44.142504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcc61e-dca6-4369-834e-3324ae9679b9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:44.148623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 50/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:43 2022] GET /identity/v3/role_assignments?user.id=987e32a36dc249e0be2146ea2ea7edc7&scope.project.id=af45de0e62764411b928277998d10f74&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:45.832670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d3dcf-d950-4b89-8691-8820647cf477 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:45.833186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d3dcf-d950-4b89-8691-8820647cf477 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:45.833288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d3dcf-d950-4b89-8691-8820647cf477 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:45.834618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 48/98] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:45.848545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48322eba-eede-4d40-bcd2-7ed0b93faf69 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:45.848980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48322eba-eede-4d40-bcd2-7ed0b93faf69 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:45.849154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48322eba-eede-4d40-bcd2-7ed0b93faf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:45.871875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-48322eba-eede-4d40-bcd2-7ed0b93faf69 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:45.873085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-48322eba-eede-4d40-bcd2-7ed0b93faf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:45.949574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:45.958242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:45.996601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d3dcf-d950-4b89-8691-8820647cf477 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.063970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36520-c5bf-4c9f-b480-469d1d97ad78 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.064286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36520-c5bf-4c9f-b480-469d1d97ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.064527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36520-c5bf-4c9f-b480-469d1d97ad78 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.065926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 52/100] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:46.072105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d61af-c3b1-4d79-b6d0-81dd3b5410ab None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.072399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d61af-c3b1-4d79-b6d0-81dd3b5410ab None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.072677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d61af-c3b1-4d79-b6d0-81dd3b5410ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.103349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-964d61af-c3b1-4d79-b6d0-81dd3b5410ab None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:46.104496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-964d61af-c3b1-4d79-b6d0-81dd3b5410ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:46.163168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d3dcf-d950-4b89-8691-8820647cf477 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.214321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 53/101] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:46.215503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87000f88-aa44-4e45-8d10-d70ccce0439f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.215793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87000f88-aa44-4e45-8d10-d70ccce0439f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.216097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87000f88-aa44-4e45-8d10-d70ccce0439f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.217359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 54/102] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:46.223707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.224019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.224304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.225193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.226011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.226295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.226572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.249406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:46.252938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:46.254146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:46.265623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:46.266607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:46.267329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 49/103] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:46.270173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.308755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:46.333226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 55/104] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:46.334073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.398618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a07d5a-f9ea-4037-aa54-a548711c09d7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.399725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:46.437865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515de7-fe03-467a-9f03-d6364da07c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.438775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515de7-fe03-467a-9f03-d6364da07c38 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.439120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515de7-fe03-467a-9f03-d6364da07c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.439406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515de7-fe03-467a-9f03-d6364da07c38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.443685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf2350-e869-41e2-9fcc-34b08826f512 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.450554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f515de7-fe03-467a-9f03-d6364da07c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2f515de7-fe03-467a-9f03-d6364da07c38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:46.459035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:46.459890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:46.460637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 50/105] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:56:46.461982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fd70e-b4e3-4ebe-a4fe-a1336baa247f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.462087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fd70e-b4e3-4ebe-a4fe-a1336baa247f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.467887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fd70e-b4e3-4ebe-a4fe-a1336baa247f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.467887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 51/106] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:46.468856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fd70e-b4e3-4ebe-a4fe-a1336baa247f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.483625 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.484338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.484620 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.484898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.485654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:46.485961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:46.487374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:46.496185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 56/107] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:46.497096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.564470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:46.580939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fd70e-b4e3-4ebe-a4fe-a1336baa247f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.600870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4b48-ad4c-447f-b29e-610610ba1b6b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.616684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19b55-b5e5-4ac2-8518-f69495c202af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.617791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19b55-b5e5-4ac2-8518-f69495c202af None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.618073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19b55-b5e5-4ac2-8518-f69495c202af None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.618346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19b55-b5e5-4ac2-8518-f69495c202af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.619127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:46.629230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19b55-b5e5-4ac2-8518-f69495c202af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-22b19b55-b5e5-4ac2-8518-f69495c202af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:46.638303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:46.639135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:46.639900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 52/108] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:46.640732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236fe9-c9b3-4397-9e0a-c74a945f00d5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.641019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236fe9-c9b3-4397-9e0a-c74a945f00d5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.641295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236fe9-c9b3-4397-9e0a-c74a945f00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.641718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.642550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.642982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.643396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.644549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:46.645016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:46.646830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:46.655623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 57/109] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:46.656616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.662237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c7236fe9-c9b3-4397-9e0a-c74a945f00d5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:46.663423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c7236fe9-c9b3-4397-9e0a-c74a945f00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:46.742149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 53/110] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:46.743359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b177bca-4073-4f78-b573-778202fe255d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.743646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b177bca-4073-4f78-b573-778202fe255d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.743929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b177bca-4073-4f78-b573-778202fe255d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.745352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 54/111] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:46.749536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b177bca-4073-4f78-b573-778202fe255d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.789373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fee3f-b464-4e85-88e4-7f729f376acd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.829662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.830711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.831769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.832093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.833339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:46.834811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:46.841608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 58/112] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:46.841608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:46.842822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:46.863562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b177bca-4073-4f78-b573-778202fe255d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.897772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:46.902623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.903390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.903675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.903986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.905092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:46.905092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:46.906448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9776-9964-492e-9c07-a3b6a969b981 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:46.917309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 55/113] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:46.918681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.918978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.919260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:46.935679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:46.937023 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:46.960933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb03ac-efb2-4859-9819-85d60934f55b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:46.997819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:46.998727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:46.999012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:46.999285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.000507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.001985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.003639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 59/114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:46 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.004462 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.017528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 56/115] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:47.018668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.095616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.116199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b2d2-b38a-4e9d-a2eb-c882402bbb3a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.130206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.131540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab2848-fd1a-436e-84fa-a60bb1782ee8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.153817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.154561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.154847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.155127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.166045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:47.169503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.170599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.171156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.171610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.173025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:47.173988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:47.174854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 60/116] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:47.176328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.180712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.182520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 57/117] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.183341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.283297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ab84-8d75-42a3-8e73-08c7961bd25a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.288502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02b26d-55d8-42d9-b60b-81bacd8d00b9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.327353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.328274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.328554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.328827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.328920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.329760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.330017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.330116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.330309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.331479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.331583 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.333064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.333200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 61/118] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.333958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.339820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 58/119] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.339820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.343136 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.384965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.442510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609da55-d6a6-4ea6-9d45-820152e00546 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.444664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af63da9-c655-4f17-9b98-81366ceb34c6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.477866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.478089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.478544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.478672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.478827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.478956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.479100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.479230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.479970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:47.480278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.480438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.481685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0ac0e-cbf2-4ab0-83d8-931dcd8bca08 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.481885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.483535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 62/120] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.484299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.491194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 59/121] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.492545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c3379-c7f9-4042-86ba-8548e96773d0 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.492839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c3379-c7f9-4042-86ba-8548e96773d0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.493179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c3379-c7f9-4042-86ba-8548e96773d0 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.494606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 60/122] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:47.495169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c3379-c7f9-4042-86ba-8548e96773d0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.562742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.586973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4350c5c-8624-403e-860b-16061e3ce028 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.597407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.600640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c3379-c7f9-4042-86ba-8548e96773d0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.623466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.624399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.624877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.625148 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/987e32a36dc249e0be2146ea2ea7edc7/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.628146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] RBAC: Authorizing `identity:create_grant(project_id=747035f4f8d34d9b99f97b83ce23e619, user_id=987e32a36dc249e0be2146ea2ea7edc7, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.630077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.634568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.635448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.635724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.636047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.637266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.638743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.640516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 61/123] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:47.645766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.649427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 63/124] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:56:47 2022] PUT /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/987e32a36dc249e0be2146ea2ea7edc7/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:56:47.650234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.756972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7d78-de34-4f3e-88bf-6e30eabd6fb0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.773067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00adcad-0d43-4096-b5ce-e0cb0e7a60bf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:47.795414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b771a-218b-4e92-8dfb-6f862b0455aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.796361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b771a-218b-4e92-8dfb-6f862b0455aa None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.796654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b771a-218b-4e92-8dfb-6f862b0455aa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.796939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b771a-218b-4e92-8dfb-6f862b0455aa None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/f51e7a8fc6624717bbfc71dfc519fca3/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.798975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b771a-218b-4e92-8dfb-6f862b0455aa None admin] RBAC: Authorizing `identity:create_grant(project_id=747035f4f8d34d9b99f97b83ce23e619, user_id=f51e7a8fc6624717bbfc71dfc519fca3, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.800740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b771a-218b-4e92-8dfb-6f862b0455aa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.806096 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.818522 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:47.819349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.819627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.819936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.821037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:47.822161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:47.823975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 62/125] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:56:47 2022] PUT /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/f51e7a8fc6624717bbfc71dfc519fca3/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:56:47.825379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:47.825646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:47.825932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:47.848200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:47.850174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:47.859061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 64/126] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:56:47 2022] POST /identity/v3/projects => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:47.860628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.890136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:47.931451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 63/127] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:47.932403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:47.979427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7944b-a758-4d6d-bdbd-494bfc3e658f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.027394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.031664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.032326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.032804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] PATH_INFO: `/v3/users/f88fb60dd4d84d5f9dc1b17627b6354e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.065427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] RBAC: Authorizing `identity:get_user(user_id=f88fb60dd4d84d5f9dc1b17627b6354e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:48.069504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:48.072626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 65/128] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:47 2022] GET /identity/v3/users/f88fb60dd4d84d5f9dc1b17627b6354e => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:48.074765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:48.096817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbfd9b-e24e-44b3-9a97-13dc441812f8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.133844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:48.152802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.153730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.154018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.154756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/987e32a36dc249e0be2146ea2ea7edc7/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.158061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=747035f4f8d34d9b99f97b83ce23e619, user_id=987e32a36dc249e0be2146ea2ea7edc7, role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:48.160109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:48.178986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 64/129] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:56:47 2022] PUT /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/987e32a36dc249e0be2146ea2ea7edc7/roles/90387e9afaca4d41b37d78e341b4e561 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:56:48.179611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:48.197930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:48.238127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8080f-3816-41ba-a934-2ef02bfad3bd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.300678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.301779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.303369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.303940 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.328725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:48.346424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:48.347519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:48.348575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:48.350570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 66/130] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:48.358431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:48.397995 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dbba5-81fc-49ea-9c94-5d5c398196e5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.441068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.442008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.442435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.442851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.508282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:48.537346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386290f-9d91-48f2-85fe-7f402dfcc70d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.544704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:48.546207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:48.576333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.577313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.577746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.578037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.578808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:48.579123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:48.580693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:48.595784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:48.601478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:48.604950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:48.783652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 65/132] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:48.789519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:48.798009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0e01-aae7-4883-a4e3-24591a87df9a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.896131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069742b-94e9-471a-9cf3-14ecee284d83 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:48.900201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:48.916600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.917521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.917805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.918086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.924602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:48.926097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:48.928104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 68/133] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:48.936787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:48.966574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:48.967805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:48.968331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:48.968801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:48.970216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:48.971909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:48.980884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 66/134] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:48.986869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:49.116164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:49.169928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92dc0d-7671-45be-8a6d-68c9c0f4bff0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:49.204329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:49.205205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:49.205491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:49.205769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] PATH_INFO: `/v3/projects/af45de0e62764411b928277998d10f74` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:49.207888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=af45de0e62764411b928277998d10f74)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:49.208485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:49.210392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 69/135] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/projects/af45de0e62764411b928277998d10f74 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:49.215830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:49.228578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738cca6-ad44-44d8-bf34-ed38127dc65f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:49.322251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:49.322927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:49.323210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:49.323485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:49.324367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] RBAC: Adding query filter params (role.id=b0d398ede9464d9f93d9f74f83d54b84, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=f88fb60dd4d84d5f9dc1b17627b6354e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:49.324684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:49.326143 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee20a-1af4-42cd-b7b4-a01a88735f45 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:49.338294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 67/136] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:48 2022] GET /identity/v3/role_assignments?user.id=f88fb60dd4d84d5f9dc1b17627b6354e&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=b0d398ede9464d9f93d9f74f83d54b84 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:49.394379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9badb-69b3-4a97-b38e-f5f032a69bf1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:49.429801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f083ef-6cc3-4743-bcda-54f70eca0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:49.430675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f083ef-6cc3-4743-bcda-54f70eca0bd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:49.430961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f083ef-6cc3-4743-bcda-54f70eca0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:49.431239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f083ef-6cc3-4743-bcda-54f70eca0bd8 None admin] PATH_INFO: `/v3/projects/af45de0e62764411b928277998d10f74/users/987e32a36dc249e0be2146ea2ea7edc7/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:49.433277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f083ef-6cc3-4743-bcda-54f70eca0bd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=af45de0e62764411b928277998d10f74, user_id=987e32a36dc249e0be2146ea2ea7edc7, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:49.434756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f083ef-6cc3-4743-bcda-54f70eca0bd8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:49.445833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:49.451827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 70/137] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:56:49 2022] PUT /identity/v3/projects/af45de0e62764411b928277998d10f74/users/987e32a36dc249e0be2146ea2ea7edc7/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 06:56:50.327837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398003-5cde-4570-af68-3d1ff2c1a6dd None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:50.328408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398003-5cde-4570-af68-3d1ff2c1a6dd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:50.328408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398003-5cde-4570-af68-3d1ff2c1a6dd None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:50.330080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 68/138] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:50.335330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:50.335782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:50.335991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:50.355186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:50.356417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:50.439877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 71/139] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:50.485379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398003-5cde-4570-af68-3d1ff2c1a6dd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:50.507798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:50.606683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398003-5cde-4570-af68-3d1ff2c1a6dd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:50.650180 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1bc2d-f2e8-4223-bd35-7cd7847d7cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:50.651003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1bc2d-f2e8-4223-bd35-7cd7847d7cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:50.651345 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1bc2d-f2e8-4223-bd35-7cd7847d7cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:50.651629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1bc2d-f2e8-4223-bd35-7cd7847d7cd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:50.667761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1bc2d-f2e8-4223-bd35-7cd7847d7cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-44f1bc2d-f2e8-4223-bd35-7cd7847d7cd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:50.678229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:50.679126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:50.679968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:50.684033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 69/140] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:50.685539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:50.729798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955299f-cba9-45c7-ac25-c6c4a0ddecfb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:50.730108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955299f-cba9-45c7-ac25-c6c4a0ddecfb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:50.730369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955299f-cba9-45c7-ac25-c6c4a0ddecfb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:50.732027 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 70/141] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:50.738408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:50.738692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:50.738968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:50.759018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:50.760260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:50.863550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fca42-1338-4314-8eb6-ef7a08406d59 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:50.897609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:50.905258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 71/142] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:50.913119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:50.913806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:50.914090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:50.914423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:50.915235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:50.915545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:50.917041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:50.926178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 72/143] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:50.931603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:50.944305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:50.947509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.110720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250c309-2e84-479b-a6a1-4fa8c9b6819d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.122958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33f28-7b8d-45b9-b4b6-60ad6cef33ec None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.151552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313b3c-6949-425b-82ea-b5c5b2e76dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.152591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313b3c-6949-425b-82ea-b5c5b2e76dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.152876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313b3c-6949-425b-82ea-b5c5b2e76dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.153153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313b3c-6949-425b-82ea-b5c5b2e76dc4 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.154571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313b3c-6949-425b-82ea-b5c5b2e76dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:51.156172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313b3c-6949-425b-82ea-b5c5b2e76dc4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:51.157822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 72/144] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:50 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:51.161035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637746e4-bcc5-4b7d-86c3-77a934e92890 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.161525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637746e4-bcc5-4b7d-86c3-77a934e92890 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.162090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637746e4-bcc5-4b7d-86c3-77a934e92890 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.164000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 73/145] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:51.169156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8df4-d3a3-484d-9628-31a1f8d0c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.169156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8df4-d3a3-484d-9628-31a1f8d0c911 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.169156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8df4-d3a3-484d-9628-31a1f8d0c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.169156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8df4-d3a3-484d-9628-31a1f8d0c911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.169725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9bb0c-2ec8-4452-8f7f-975eb032e699 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.170255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9bb0c-2ec8-4452-8f7f-975eb032e699 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.170734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9bb0c-2ec8-4452-8f7f-975eb032e699 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.172511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 74/146] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:51.173448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9bb0c-2ec8-4452-8f7f-975eb032e699 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.182838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8df4-d3a3-484d-9628-31a1f8d0c911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a8ba8df4-d3a3-484d-9628-31a1f8d0c911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:51.191023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:51.191892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:51.192670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:51.195966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 73/147] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:51.197300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c138-8f8f-49a7-bbe0-4e7bf6bdea2f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.197592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c138-8f8f-49a7-bbe0-4e7bf6bdea2f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.197870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c138-8f8f-49a7-bbe0-4e7bf6bdea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.217305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-adf7c138-8f8f-49a7-bbe0-4e7bf6bdea2f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:51.218488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-adf7c138-8f8f-49a7-bbe0-4e7bf6bdea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:51.263012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:51.275828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:51.297268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:51.298509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.298860 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.299141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.300276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9bb0c-2ec8-4452-8f7f-975eb032e699 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.316041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:51.317462 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:51.342123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.343512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.344006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.344567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.390132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 75/149] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:51.396250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.454039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:51.457712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:51.490340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f17b6-5bb8-40b5-b225-38ead440d0cf None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.501227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:51.525559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.526587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.526587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.526915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.527743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:51.528154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:51.529635 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:51.537853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 76/150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:51.542589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.551261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:51.586233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 75/151] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:51.586233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.678598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd28523-8118-47e0-aceb-4e63fc9ad0d4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.705638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092070-8f3b-42e4-8c1b-aa9f98fd1cd4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.716986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.717941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.718454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.718724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.730088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:51.738730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:51.739578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:51.740583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 77/152] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:51.741737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.755292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.756493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.756827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.757108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.758604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:51.761000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:51.763359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 76/153] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:51.764248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.778117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:51.814370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:51.864602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b386108-1c92-4880-b604-ded67c4609d7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.880640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc512a-113c-4717-b773-4cc41975866d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:51.901358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.902612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.903088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.903564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] PATH_INFO: `/v3/users/f51e7a8fc6624717bbfc71dfc519fca3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.905051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] RBAC: Authorizing `identity:get_user(user_id=f51e7a8fc6624717bbfc71dfc519fca3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:51.906760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:51.908916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 78/154] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/users/f51e7a8fc6624717bbfc71dfc519fca3 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:51.909867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:51.921332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:51.922220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:51.922503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:51.922779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:51.924019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:51.925575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:51.927423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 77/155] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:51.932873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.016901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.020881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eabfa-49bd-4d13-aee8-0e8efe0b8875 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.037583 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31de9-aca7-4099-af1d-05ff806d0be1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.049115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.059362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.060352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.060917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.061403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.062351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:52.062849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.064662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.074132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 79/156] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:52.074850 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.075488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.075590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.075882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.076162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.076988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.078611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.101398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 78/157] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:56:51 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:52.108977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.194335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d9d2-cefd-4a7b-9558-7f85cbd8fee0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.231284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e92da5-90ab-4f90-b046-d379c663ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.231986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e92da5-90ab-4f90-b046-d379c663ba5e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.232264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e92da5-90ab-4f90-b046-d379c663ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.232536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e92da5-90ab-4f90-b046-d379c663ba5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.265689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.268130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ba67d-7203-43e8-81fd-a5170dddf0b0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.308416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.309097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.309446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.309698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.310442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e92da5-90ab-4f90-b046-d379c663ba5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.310542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=987e32a36dc249e0be2146ea2ea7edc7) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:52.310800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.311985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e92da5-90ab-4f90-b046-d379c663ba5e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.312363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.319210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 79/158] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/role_assignments?user.id=987e32a36dc249e0be2146ea2ea7edc7&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:52.323886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.369904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.463287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 80/159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:52.466109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c411-b0af-41ad-9582-09568d2e8036 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.466399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c411-b0af-41ad-9582-09568d2e8036 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.466675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c411-b0af-41ad-9582-09568d2e8036 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.468201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 81/160] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:52.469364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b1c8-1f70-4e93-bb0d-70b4610046fd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.469601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b1c8-1f70-4e93-bb0d-70b4610046fd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.469874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b1c8-1f70-4e93-bb0d-70b4610046fd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.471100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 82/161] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:52.471784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b1c8-1f70-4e93-bb0d-70b4610046fd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.489134 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae026-db5e-46e1-8887-0467266c4ab9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.544382 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c396f-47ba-4619-86b1-2b60b07f3192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.545700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c396f-47ba-4619-86b1-2b60b07f3192 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.545980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c396f-47ba-4619-86b1-2b60b07f3192 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.546256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c396f-47ba-4619-86b1-2b60b07f3192 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.547507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c396f-47ba-4619-86b1-2b60b07f3192 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.549841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c396f-47ba-4619-86b1-2b60b07f3192 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.552072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 80/162] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:52.553587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.553873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.554151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.561730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.582959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:52.584871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:52.612266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b1c8-1f70-4e93-bb0d-70b4610046fd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.654281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53060b-e742-414b-ac53-d9661d9a2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.655531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53060b-e742-414b-ac53-d9661d9a2784 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.656056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53060b-e742-414b-ac53-d9661d9a2784 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.657027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53060b-e742-414b-ac53-d9661d9a2784 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.658521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53060b-e742-414b-ac53-d9661d9a2784 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.661295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53060b-e742-414b-ac53-d9661d9a2784 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.664081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 83/163] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:52.666189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb85c2-577d-469a-b496-342e0212162e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.666790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb85c2-577d-469a-b496-342e0212162e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.667312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb85c2-577d-469a-b496-342e0212162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.682725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 81/164] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:52.683762 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.687183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-44eb85c2-577d-469a-b496-342e0212162e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:52.688724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-44eb85c2-577d-469a-b496-342e0212162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:52.743486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.781623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 84/165] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:52.782476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb85c2-577d-469a-b496-342e0212162e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:52.845385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bb3b7-8e47-46a7-8148-c3831db3566e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.848585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:52.890379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.891373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.891997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.892283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.894599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb85c2-577d-469a-b496-342e0212162e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:52.942617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:52.945579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:52.946077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:52.946554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:52.948446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=f51e7a8fc6624717bbfc71dfc519fca3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:52.951426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:52.953142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:52.966586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 85/166] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/role_assignments?user.id=f51e7a8fc6624717bbfc71dfc519fca3&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:52.967879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.018638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:53.021488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:53.071999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:53.193145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532368e-f612-486f-9742-cda5bde3b18f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.241231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:53.263588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 82/167] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:53.264503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.265253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.266080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.266364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.266641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.282766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:53.291048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:53.292128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:56:53.292886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:53.295469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 86/168] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:53.296475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.424634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346a503-cdde-4d1d-8344-6e566e88def5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.437117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b513c-244f-4786-b502-23a2ec36879e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.465748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:53.476073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.477994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.478484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.478951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.480425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:53.482109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:53.484146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 87/169] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:53.485143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.485626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.486507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.486790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.487060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.505122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:53.517148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:53.518062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:53.518828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 83/170] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:53.523988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.551035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:53.597730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954858ae-6a85-4bda-a19a-9dfea58a9728 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.632636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.633668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.634124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.634572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.635621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:53.636305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:53.638036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:53.647089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 88/171] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:53.648132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.733965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e126c-ccac-4cec-a71c-2b91a85c1af9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.750867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55305b7-f567-4386-87f8-9b8e4641811c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.768215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:53.791110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.792234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.793516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.794617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.795735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:53.797375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:53.799546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:53.813603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 89/172] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:53.817064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.817971 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.818896 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.819353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.819796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.820919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] RBAC: Adding query filter params (role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=987e32a36dc249e0be2146ea2ea7edc7) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:53.821435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:53.823118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:53.844024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 84/173] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/role_assignments?user.id=987e32a36dc249e0be2146ea2ea7edc7&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:53.845026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:53.934326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:53.936470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc46cd-47f5-411b-b2aa-15159a45f538 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:53.977293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:53.978851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:53.979419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:53.979897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] PATH_INFO: `/v3/users/f88fb60dd4d84d5f9dc1b17627b6354e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:53.981443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] RBAC: Authorizing `identity:get_user(user_id=f88fb60dd4d84d5f9dc1b17627b6354e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:53.983371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:53.985296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 90/174] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/users/f88fb60dd4d84d5f9dc1b17627b6354e => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:53.990833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:54.035293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7c62c-0863-4da9-90de-f6989319bd44 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:54.084310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:54.109891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:54.110953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:54.111335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:54.111711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] PATH_INFO: `/v3/users/987e32a36dc249e0be2146ea2ea7edc7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:54.114501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] RBAC: Authorizing `identity:get_user(user_id=987e32a36dc249e0be2146ea2ea7edc7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:54.116146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:54.119052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 85/175] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/users/987e32a36dc249e0be2146ea2ea7edc7 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:54.125722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:54.194695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dab9-d4b9-4c57-9877-7e60ce318558 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:54.241131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:54.242012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:54.242348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:54.242636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:54.244047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:54.245499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:54.247210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 91/176] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:53 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:54.256930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:54.288014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c065122-36b9-4fc7-b5b4-04b72fc84a27 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:54.308475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:54.322865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:54.323645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:54.324051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:54.324419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:54.395822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:54.397477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:54.410780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3e09d-222d-479c-91d1-bcaddeebdd50 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:54.458196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:54.464391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:54.465305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:54.465595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:54.465877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/f88fb60dd4d84d5f9dc1b17627b6354e/roles/b0d398ede9464d9f93d9f74f83d54b84` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:54.473340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] RBAC: Authorizing `identity:create_grant(project_id=747035f4f8d34d9b99f97b83ce23e619, user_id=f88fb60dd4d84d5f9dc1b17627b6354e, role_id=b0d398ede9464d9f93d9f74f83d54b84)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:54.475095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:54.500762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 92/177] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:56:54 2022] PUT /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619/users/f88fb60dd4d84d5f9dc1b17627b6354e/roles/b0d398ede9464d9f93d9f74f83d54b84 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:56:54.501622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 86/178] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:54.509336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:54.658333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32d8f-0eb9-4958-a394-590b8cc531ee None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:54.694466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75d0a7-2582-4c79-bbef-a9002d40c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:54.695344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d0a7-2582-4c79-bbef-a9002d40c036 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:54.695700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d0a7-2582-4c79-bbef-a9002d40c036 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:54.696006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d0a7-2582-4c79-bbef-a9002d40c036 None admin] PATH_INFO: `/v3/projects/af45de0e62764411b928277998d10f74` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:54.697220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75d0a7-2582-4c79-bbef-a9002d40c036 None admin] RBAC: Authorizing `identity:get_project(project_id=af45de0e62764411b928277998d10f74)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:54.698688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75d0a7-2582-4c79-bbef-a9002d40c036 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:54.700438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 93/179] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:54 2022] GET /identity/v3/projects/af45de0e62764411b928277998d10f74 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:54.706518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:54.728808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:54.812926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3475-0c9d-489c-a973-5cfc7783a474 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:54.863376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:54.864111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:54.864393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:54.864712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:54.865567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=af45de0e62764411b928277998d10f74, user.id=987e32a36dc249e0be2146ea2ea7edc7) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:54.865880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:54.867534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe08426-a97f-489e-b186-ec90b796230f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:54.876898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 87/180] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:54 2022] GET /identity/v3/role_assignments?user.id=987e32a36dc249e0be2146ea2ea7edc7&scope.project.id=af45de0e62764411b928277998d10f74&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:55.063709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3a71-265f-4144-be34-cebed4beedf7 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.064109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3a71-265f-4144-be34-cebed4beedf7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.064291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3a71-265f-4144-be34-cebed4beedf7 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.065914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 94/181] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:55.071339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5070-f8f0-4c92-9ce8-5e092850b56c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.071631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5070-f8f0-4c92-9ce8-5e092850b56c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.071938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5070-f8f0-4c92-9ce8-5e092850b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.089525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fead5070-f8f0-4c92-9ce8-5e092850b56c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:55.090716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fead5070-f8f0-4c92-9ce8-5e092850b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:55.162429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 88/182] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:55.185751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b3a71-265f-4144-be34-cebed4beedf7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.232024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:55.296318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5595d-78f1-40a2-9db8-16e44b56edca None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.296664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5595d-78f1-40a2-9db8-16e44b56edca None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.296889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5595d-78f1-40a2-9db8-16e44b56edca None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.297227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b3a71-265f-4144-be34-cebed4beedf7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:55.298507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 89/183] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:55.309435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de9aa-a108-415e-9ba2-ac5991470fa9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.309717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de9aa-a108-415e-9ba2-ac5991470fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.309989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de9aa-a108-415e-9ba2-ac5991470fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.329988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d43de9aa-a108-415e-9ba2-ac5991470fa9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:55.331103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d43de9aa-a108-415e-9ba2-ac5991470fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:55.339375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6116f3c-fb7d-473a-92c9-debd2fd27842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:55.340249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116f3c-fb7d-473a-92c9-debd2fd27842 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.340542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116f3c-fb7d-473a-92c9-debd2fd27842 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.340818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116f3c-fb7d-473a-92c9-debd2fd27842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.343967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:55.355233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116f3c-fb7d-473a-92c9-debd2fd27842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e6116f3c-fb7d-473a-92c9-debd2fd27842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:55.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:55.366207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:55.366981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:55.368515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 95/184] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:55.369426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb3ff5-3321-4efb-8abe-a178e7c7c1db None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.369426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb3ff5-3321-4efb-8abe-a178e7c7c1db None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.369589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb3ff5-3321-4efb-8abe-a178e7c7c1db None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.371021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 96/185] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:55.376529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb3ff5-3321-4efb-8abe-a178e7c7c1db None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.420630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 90/186] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:55.429332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.429724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.430081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.453048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:55.454804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:55.491696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:55.497176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb3ff5-3321-4efb-8abe-a178e7c7c1db None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:55.528297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 91/187] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:55.529684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.539242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:55.540580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.541063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.541683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.542711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:55.543256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:55.545162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:55.554902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 97/188] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:55.557033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.613575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:55.642589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659325ea-0d0c-4b85-8ce6-09fca3bbfe83 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:55.662231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d286b-132a-41f7-b3b8-8d306bad5df4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:55.682868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:55.684113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.684400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.684775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.685838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:55.687299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:55.689262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 92/189] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:55.689922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.701998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:55.702810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.703089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.703359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.714180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:55.722393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:55.723222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:55.724096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 98/190] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:56:55.724723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.753999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:55.807372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0ac2-2134-4835-a8ad-207eccc869da None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:55.834693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f2700-c554-465c-b916-9c32eed383a9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:55.844789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:55.845788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.846060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.846325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] PATH_INFO: `/v3/users/cd93ac5b38db4f0db48cf8187e84f37a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.860534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:55.864055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] RBAC: Authorizing `identity:get_user(user_id=cd93ac5b38db4f0db48cf8187e84f37a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:55.866021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:55.867975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 93/191] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/users/cd93ac5b38db4f0db48cf8187e84f37a => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:55.870759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:55.871429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:55.871709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:55.872107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:55.872752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:55.873150 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:55.874261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:55.903874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 99/192] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:56:55 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:56:55.903874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.002852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:56.024878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db0bb-ad2c-49ee-aa58-370525e20b77 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.028462 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef1c13-7fab-408a-97f0-9171d3d638b4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.067415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.068118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.068397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.068667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.073569 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.074255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.074538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.074814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.075574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:56.075907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.077318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.089437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 94/193] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:56.095253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.161417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.163607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.172450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:56.220239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d530d-56fb-4673-91ee-f087b3ebd8b4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.265602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.266820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.267108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.267387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] PATH_INFO: `/v3/users/cd93ac5b38db4f0db48cf8187e84f37a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.268810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] RBAC: Authorizing `identity:get_user(user_id=cd93ac5b38db4f0db48cf8187e84f37a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.270607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:56.270792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.272513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 95/194] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/users/cd93ac5b38db4f0db48cf8187e84f37a => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:56.278932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.295535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 100/195] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:56.300949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.431557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fc60-0263-4980-8f5b-41e4b7b3b83f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.477213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:56.479032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d147-c458-4418-8edc-ee598fdb13b3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.484936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.486495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.486781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.487058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.563540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.564547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.565053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.565442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.565717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.565986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.567222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.568697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.570459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 101/196] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:56.576170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.680988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:56.712167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 96/197] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:56.716656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.757296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d544-365c-4349-8feb-d5c575506879 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.774497 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:56.792550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.793218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.793500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.793776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.794619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] RBAC: Adding query filter params (role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=cd93ac5b38db4f0db48cf8187e84f37a) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:56.794927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.796424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e118aa-fc86-4593-8480-cdfffc7efd01 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.802435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 102/198] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/role_assignments?user.id=cd93ac5b38db4f0db48cf8187e84f37a&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:56.803567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d606ca-7129-42c0-894e-840698213650 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.803762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d606ca-7129-42c0-894e-840698213650 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.804051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d606ca-7129-42c0-894e-840698213650 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.805364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 103/199] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:56.812120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.812547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.812922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.830384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:56.831763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:56.858307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e0d6-a1cd-4e3b-8633-748388d19f46 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:56.895594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:56.896606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:56.896887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:56.897157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:56.898528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:56.900149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:56.902353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 97/200] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:56.909966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:56.912416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 104/201] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:56.939021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:57.024315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:57.090487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:57.096454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c2584-1bce-4d05-afb4-eca341344b51 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:57.112398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0c64-e5dc-4980-bf4d-d153183b0dc6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:57.165587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:57.166252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:57.166530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:57.166800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:57.167640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=cd93ac5b38db4f0db48cf8187e84f37a) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:57.167977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:57.169430 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:57.180864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:57.181671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:57.181950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:57.182224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:57.185958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 98/202] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/role_assignments?user.id=cd93ac5b38db4f0db48cf8187e84f37a&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:57.195732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:57.203887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:57.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:57.206499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 105/203] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:56:57.211129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:57.318927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071052cb-6f22-4150-9052-2a497ecab8e9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:57.356839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:57.357527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:57.357805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:57.358072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:57.358829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:57.359132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:57.360566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:57.371402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 99/204] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:57.379869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:57.528888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:57.532363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feecf08-489f-43be-bc54-a44873184037 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:57.580854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:57.581671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:57.581948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:57.582224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] PATH_INFO: `/v3/users/f88fb60dd4d84d5f9dc1b17627b6354e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:57.583497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f88fb60dd4d84d5f9dc1b17627b6354e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:57.585117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:57.586845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 106/205] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:57 2022] GET /identity/v3/users/f88fb60dd4d84d5f9dc1b17627b6354e => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:57.592524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:57.630607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:57.717303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbd62-47cd-4810-9eb2-a2ff0a08f4fe None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:57.751005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:57.751668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:57.751980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:57.752253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:57.823723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:57.825577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:57.852310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:57.929514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 100/206] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:56:57.934998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:58.067536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3d27-5351-41de-bf4d-cb5b2cbcb8d1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:58.113568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297543d-cfd7-44c3-a84f-d09452e8de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:58.114380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297543d-cfd7-44c3-a84f-d09452e8de6e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.114724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297543d-cfd7-44c3-a84f-d09452e8de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.114997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297543d-cfd7-44c3-a84f-d09452e8de6e None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.116299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297543d-cfd7-44c3-a84f-d09452e8de6e None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:58.118021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297543d-cfd7-44c3-a84f-d09452e8de6e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:58.119904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 107/207] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:57 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:58.126536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:58.244340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e11d3-7daf-45cf-a344-a98f4a2f121f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:58.269103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:58.280287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:58.280950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.281229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.281498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.282331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] RBAC: Adding query filter params (role.id=b0d398ede9464d9f93d9f74f83d54b84, scope.project.id=747035f4f8d34d9b99f97b83ce23e619, user.id=f88fb60dd4d84d5f9dc1b17627b6354e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:58.282639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:58.284138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeb2a-5af4-46ee-ab5c-ce86cf425af7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:58.290675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 101/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:58 2022] GET /identity/v3/role_assignments?user.id=f88fb60dd4d84d5f9dc1b17627b6354e&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=b0d398ede9464d9f93d9f74f83d54b84 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:58.503981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b441b62-c678-462f-8cec-8c6d8a328c40 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.504646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b441b62-c678-462f-8cec-8c6d8a328c40 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.505080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b441b62-c678-462f-8cec-8c6d8a328c40 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.506617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 108/209] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:58.511979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1cf5-9ae5-4010-987d-1174d32ff4e5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.512502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1cf5-9ae5-4010-987d-1174d32ff4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.512991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1cf5-9ae5-4010-987d-1174d32ff4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.533543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3a5c1cf5-9ae5-4010-987d-1174d32ff4e5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:58.535020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3a5c1cf5-9ae5-4010-987d-1174d32ff4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:58.608130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 102/210] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:58.633011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b441b62-c678-462f-8cec-8c6d8a328c40 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:58.675536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:58.717222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3342f-3f46-4ea7-839b-54f2a1510f06 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.717533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3342f-3f46-4ea7-839b-54f2a1510f06 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.717775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3342f-3f46-4ea7-839b-54f2a1510f06 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.719173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 103/211] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:56:58.724206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.724490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.724765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.749356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:58.751260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:58.758331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b441b62-c678-462f-8cec-8c6d8a328c40 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:58.798978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:58.800053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.800509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.800924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.811439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:58.819835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:58.820915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:56:58.821692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 109/212] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:56:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:56:58.827948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:58.835105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 104/213] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:58.860335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:58.916395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:58.924397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:58.930602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb844fa-40f3-4f5f-bdb6-d8eab8c74252 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:58.965408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:58.966346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:58.966834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:58.967301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:58.968274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:58.968777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:58.970351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:58.972628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6070-64f7-4958-bb68-980f0c155859 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:58.979832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 110/214] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:56:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:58.985497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.015406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.016296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.016981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.017265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.018693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.020826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.023053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 105/215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:56:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:59.028241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.093637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81559-fabd-423b-b9f9-bd0f0409e27d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.130083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.131272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.131749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.132256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] PATH_INFO: `/v3/users/00210df8112748f8b505b14873bdea09` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.147063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] RBAC: Authorizing `identity:get_user(user_id=00210df8112748f8b505b14873bdea09)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.148919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.150856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 111/216] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:58 2022] GET /identity/v3/users/00210df8112748f8b505b14873bdea09 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:56:59.156415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.167428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d7db-7ac4-4031-89c0-8800d6288800 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.177142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:59.192286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:59.216435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d212d-bc25-498a-8ee7-1933035c2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.217147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d212d-bc25-498a-8ee7-1933035c2db1 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.217433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d212d-bc25-498a-8ee7-1933035c2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.217705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d212d-bc25-498a-8ee7-1933035c2db1 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.218431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d212d-bc25-498a-8ee7-1933035c2db1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.220476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d212d-bc25-498a-8ee7-1933035c2db1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.251769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 106/217] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:56:59 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:56:59.279535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b06e-b43c-4710-b9e7-2ff76bc37575 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.313565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bda29-dd85-4a12-818d-9623c2310b01 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.313834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bda29-dd85-4a12-818d-9623c2310b01 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.314214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bda29-dd85-4a12-818d-9623c2310b01 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.315917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 107/218] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:59.321737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.321957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.322285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.322658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.323100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.323533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.323989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.340794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:59.342169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:59.406459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.408507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.420002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 108/219] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:56:59.427556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:59.439118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.531865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 112/220] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 06:56:59.537544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.563817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79c80d-7fab-4c7e-bcb3-e57da42c2e11 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.566801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:59.610747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd6be-069a-4ab0-85a0-98106dbbfeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.612118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd6be-069a-4ab0-85a0-98106dbbfeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.612437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd6be-069a-4ab0-85a0-98106dbbfeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.612829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd6be-069a-4ab0-85a0-98106dbbfeb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.628992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dd6be-069a-4ab0-85a0-98106dbbfeb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-eb7dd6be-069a-4ab0-85a0-98106dbbfeb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:56:59.639244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:56:59.640214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:56:59.640985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:56:59.642879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 109/221] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:56:59.644644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac21b0-8027-4da1-9665-08abc5867a86 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.644944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac21b0-8027-4da1-9665-08abc5867a86 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.645224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac21b0-8027-4da1-9665-08abc5867a86 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.647219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 110/222] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:56:59.653433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.653729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.654261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.664712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e860-4c23-4c35-b653-a5bd6629ba88 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.673700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:56:59.674814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:56:59.688140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:59.706797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.708389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.708813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.709445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.711146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.712903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.716078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 113/223] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:59.717038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.753650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 111/224] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:56:59.759870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.845765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d24c8-1298-403a-8210-790494a74162 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.881072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:56:59.890908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bf97-4489-4e8e-87dc-cded13e5c759 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:56:59.897103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.897865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.898218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.898597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.899430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:59.899805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.901868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.918406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 114/225] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:59.918406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:56:59.935670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:56:59.937728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:56:59.938025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:56:59.938268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:56:59.939109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=00210df8112748f8b505b14873bdea09) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:56:59.939413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:56:59.941181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:56:59.946648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 112/226] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/role_assignments?user.id=00210df8112748f8b505b14873bdea09&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:56:59.952048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:00.000909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:00.080284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda9df5-b694-4083-8674-75bf18eeb830 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.128876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.130077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.130786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.131701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.149221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:00.158440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:00.159352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:00.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:00.161243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617da49-ce70-4e14-96f2-12adc1595cd6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.161645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 115/227] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:00.169823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:00.232303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.233173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.233448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.233713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] PATH_INFO: `/v3/users/cd93ac5b38db4f0db48cf8187e84f37a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.234947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] RBAC: Authorizing `identity:get_user(user_id=cd93ac5b38db4f0db48cf8187e84f37a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:00.236504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:00.241584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 113/228] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:56:59 2022] GET /identity/v3/users/cd93ac5b38db4f0db48cf8187e84f37a => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:00.247731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:00.291830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:00.351106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4f59-4562-43d4-b602-417e5a0be4bd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.362378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:00.419066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.419746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.420046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.420318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.421077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:00.421380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:00.422768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:00.431916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3692-238f-4525-85a8-5df6bd4cf895 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.446371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 116/229] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:00.452150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:00.500181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.500980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.502296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.502586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.504545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:00.508458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:00.512638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 114/230] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:00 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:00.518511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:00.644781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bf96a-1c2c-4b26-aacf-44d847fb312a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.699890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:00.711905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a3cfb-027a-478a-941f-981e0a3537f1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.714608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.715518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.715798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.716143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] PATH_INFO: `/v3/users/cd93ac5b38db4f0db48cf8187e84f37a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.717451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] RBAC: Authorizing `identity:get_user(user_id=cd93ac5b38db4f0db48cf8187e84f37a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:00.718885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:00.725761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 117/231] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:00 2022] GET /identity/v3/users/cd93ac5b38db4f0db48cf8187e84f37a => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:00.727029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:00.765642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:00.799465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.800689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.801272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.802477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/cd93ac5b38db4f0db48cf8187e84f37a/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.806751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9932c8860f4ad881a95e4095cda755, user_id=cd93ac5b38db4f0db48cf8187e84f37a, role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:00.809127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:00.831237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 115/232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:00 2022] PUT /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/cd93ac5b38db4f0db48cf8187e84f37a/roles/90387e9afaca4d41b37d78e341b4e561 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:00.876464 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c6e1-0b6b-4ef2-bf66-295b3a3e66df None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:00.927990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cadd0-7f53-4ada-9266-1f3467237a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:00.929124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cadd0-7f53-4ada-9266-1f3467237a43 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:00.929551 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cadd0-7f53-4ada-9266-1f3467237a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:00.930041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cadd0-7f53-4ada-9266-1f3467237a43 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:00.931477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cadd0-7f53-4ada-9266-1f3467237a43 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:00.933163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cadd0-7f53-4ada-9266-1f3467237a43 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:00.935093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 118/233] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:00 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:00.941079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:01.064554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a419e-887f-4924-9753-2ccbd4d53156 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:01.099477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5667ca-118b-433a-87cb-f716c3030e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:01.100423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5667ca-118b-433a-87cb-f716c3030e67 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:01.100704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5667ca-118b-433a-87cb-f716c3030e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:01.100980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5667ca-118b-433a-87cb-f716c3030e67 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/cd93ac5b38db4f0db48cf8187e84f37a/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:01.103359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5667ca-118b-433a-87cb-f716c3030e67 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9932c8860f4ad881a95e4095cda755, user_id=cd93ac5b38db4f0db48cf8187e84f37a, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:01.106291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5667ca-118b-433a-87cb-f716c3030e67 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:01.122149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 116/234] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:00 2022] PUT /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/cd93ac5b38db4f0db48cf8187e84f37a/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:01.711053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9cf8-6adf-4a83-8737-ec70003349d8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:01.711249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9cf8-6adf-4a83-8737-ec70003349d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:01.711531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9cf8-6adf-4a83-8737-ec70003349d8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:01.713193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 119/235] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:01.718201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067550fa-251a-495a-b070-32cbd673fafb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:01.718661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067550fa-251a-495a-b070-32cbd673fafb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:01.718763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067550fa-251a-495a-b070-32cbd673fafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:01.741548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-067550fa-251a-495a-b070-32cbd673fafb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:01.742847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-067550fa-251a-495a-b070-32cbd673fafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:01.753964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:01.818290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 117/236] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:01.849252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a9cf8-6adf-4a83-8737-ec70003349d8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:01.946515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581778-4fc2-4e17-b567-8addd42c66ad None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:01.946879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581778-4fc2-4e17-b567-8addd42c66ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:01.947077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581778-4fc2-4e17-b567-8addd42c66ad None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:01.948758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 118/237] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:01.953651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:01.953940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:01.954220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:01.967905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a9cf8-6adf-4a83-8737-ec70003349d8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:01.972164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:01.989591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:01.990781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:02.017390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.018262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.018542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.018812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.036234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:02.042122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:02.043007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:02.044218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 120/238] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:02.050138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.126787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 119/239] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:02.162725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.182352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d7fb-659f-4f66-9379-1c60688a983d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.224894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.227133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.228944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.229429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.230400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:02.232455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:02.234093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:02.255910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 121/240] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:02.263017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.313013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:02.322147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:02.354290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba51c2-4f90-43c0-94a2-7ee8d2b1813e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.397290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b84c99-b108-4ce2-b93b-cf07b8a81769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.398436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84c99-b108-4ce2-b93b-cf07b8a81769 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.398902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84c99-b108-4ce2-b93b-cf07b8a81769 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.399395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84c99-b108-4ce2-b93b-cf07b8a81769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.400786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b84c99-b108-4ce2-b93b-cf07b8a81769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:02.402461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b84c99-b108-4ce2-b93b-cf07b8a81769 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:02.404639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 120/241] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:02.406061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52230c6-9813-48af-8b20-ccda9674a61d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.406534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52230c6-9813-48af-8b20-ccda9674a61d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.406995 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52230c6-9813-48af-8b20-ccda9674a61d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.411933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 121/242] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:02.412987 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52230c6-9813-48af-8b20-ccda9674a61d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.415261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07936a-25c5-41e8-b30a-5ea6985cd93d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.459332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e5230-cd46-4733-b208-2e724630d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.460545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5230-cd46-4733-b208-2e724630d24a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.460849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5230-cd46-4733-b208-2e724630d24a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.461124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5230-cd46-4733-b208-2e724630d24a None admin] PATH_INFO: `/v3/users/2ec3b7064c564aa19605cbae7ce60717` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.476749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e5230-cd46-4733-b208-2e724630d24a None admin] RBAC: Authorizing `identity:get_user(user_id=2ec3b7064c564aa19605cbae7ce60717)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:02.478465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e5230-cd46-4733-b208-2e724630d24a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:02.480534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 122/243] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/users/2ec3b7064c564aa19605cbae7ce60717 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:02.481774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.482041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.482313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.498469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:02.499606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:02.539123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52230c6-9813-48af-8b20-ccda9674a61d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.573644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.574340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.574582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.574934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.575574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:02.577058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:02.582032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 123/244] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:02.583150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.597790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:02.602849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:02.617904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 122/245] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:02 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:02.619240 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.702839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146de5-8cba-496a-84c8-4570b89fd0c9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.728716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b4006-393a-4f90-b28e-029a5b80c628 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.744792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.746036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.746553 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.747141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.763954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.764771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.765046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.765317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.776516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:02.784534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:02.785487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:02.787015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 123/246] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:02.792216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.829537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:02.831484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:02.856320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:02.857282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:02.903120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ab31-d769-4e44-86be-e28aef06ced8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:02.942020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:02.942931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:02.943039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:02.943261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:02.944051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:02.944357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:02.945877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:02.947871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 124/247] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:02.955475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:02.957350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 124/248] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:02.962578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:03.064409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fa68-3724-4e71-b5bb-032a73bce6de None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:03.067406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40606545-d317-43ee-97ac-17aa73486152 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:03.081775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:03.096265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:03.099566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:03.100487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.100762 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.101029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] PATH_INFO: `/v3/users/00210df8112748f8b505b14873bdea09` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.103940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] RBAC: Authorizing `identity:get_user(user_id=00210df8112748f8b505b14873bdea09)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:03.105465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:03.107462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 125/249] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/users/00210df8112748f8b505b14873bdea09 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:03.110204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:03.111200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.111490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.111871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.112880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:03.113118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:03.114704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:03.116686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 125/250] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:02 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:03.124338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:03.225453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836f34-956f-433b-b5db-6e822686d263 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:03.238693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965921b-3c5f-4047-94a4-e64c1da69207 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:03.260643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:03.261526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.261808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.262080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.263266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:03.264743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:03.272154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 126/251] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:03 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:03.273026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:03.277239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:03.277915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.278201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.278479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.279335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] RBAC: Adding query filter params (role.id=b0d398ede9464d9f93d9f74f83d54b84, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=2ec3b7064c564aa19605cbae7ce60717) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:03.279651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:03.281658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a5b61-02ea-48a6-88dc-75667805c5e6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:03.288510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 126/252] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:03 2022] GET /identity/v3/role_assignments?user.id=2ec3b7064c564aa19605cbae7ce60717&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=b0d398ede9464d9f93d9f74f83d54b84 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:03.344001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:03.408193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e151-fdaf-45f8-b197-7a4f45ef276b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:03.449334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:03.450272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.450573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.450851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/00210df8112748f8b505b14873bdea09/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.452953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9932c8860f4ad881a95e4095cda755, user_id=00210df8112748f8b505b14873bdea09, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:03.454445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:03.469655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fd98a-0510-461f-b8a4-06199ae49b10 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.469974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fd98a-0510-461f-b8a4-06199ae49b10 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.470269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fd98a-0510-461f-b8a4-06199ae49b10 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.471904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 127/254] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:03 2022] PUT /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/00210df8112748f8b505b14873bdea09/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:03.472019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 127/254] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:03.477779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.478100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.478354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.504562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:03.505810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:03.563341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:03.606966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 128/255] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:03.653409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:03.775292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f707-bd43-4cab-8cff-7e98106f18a1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:03.790179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:03.811436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815b6ac-e657-4495-8114-e75c2b5ec06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:03.812651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b6ac-e657-4495-8114-e75c2b5ec06a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.813367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b6ac-e657-4495-8114-e75c2b5ec06a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.813642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b6ac-e657-4495-8114-e75c2b5ec06a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.825866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815b6ac-e657-4495-8114-e75c2b5ec06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f815b6ac-e657-4495-8114-e75c2b5ec06a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:03.835740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:03.837046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:03.837805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 128/256] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:03.844432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:03.858178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8c95-3da5-43a0-be60-1f1ba9a2f1cd None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.858768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8c95-3da5-43a0-be60-1f1ba9a2f1cd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.859235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8c95-3da5-43a0-be60-1f1ba9a2f1cd None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.861266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 129/257] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:03.866619 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:03.867217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:03.867688 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:03.891612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:03.893134 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:04.025848 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e766-d348-417f-aa55-6e4af544c192 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:04.050463 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 130/258] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:04.084563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:04.085256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:04.085538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:04.085878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:04.086653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:04.086960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:04.088418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:04.090691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.118613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 129/259] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:04.128930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.206128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:04.238545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b753b-c206-441a-8c3f-e8978ca79927 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:04.252287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:04.298487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6d81-0560-4b85-beaa-c88d3952ad0f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:04.305570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:04.306399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:04.306682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:04.306961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:04.326460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:04.339249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:04.340188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:04.340956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:04.341534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 131/260] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:04.342826 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:04.343789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:04.344098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:04.344373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] PATH_INFO: `/v3/users/cd93ac5b38db4f0db48cf8187e84f37a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:04.348195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] RBAC: Authorizing `identity:get_user(user_id=cd93ac5b38db4f0db48cf8187e84f37a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:04.348609 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.349680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:04.351675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 130/261] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/users/cd93ac5b38db4f0db48cf8187e84f37a => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:04.357062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.499786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7611b-c7a7-4606-aa3f-f64f5f27bb9f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:04.506999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:04.535321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ce44-7698-4360-9b25-3ee3d6b6578c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:04.573011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:04.573691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:04.573967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:04.574235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:04.574992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:04.575297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:04.576940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:04.580790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:04.581691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:04.582112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:04.582524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:04.586359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 132/262] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:04.592638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.645644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:04.708043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:04.709749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:04.792332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc2f74-06aa-41e3-a48e-052ce5bfc659 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:04.854330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:04.855492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:04.855768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:04.856068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] PATH_INFO: `/v3/users/cd93ac5b38db4f0db48cf8187e84f37a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:04.857525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] RBAC: Authorizing `identity:get_user(user_id=cd93ac5b38db4f0db48cf8187e84f37a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:04.859121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:04.861801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 133/263] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/users/cd93ac5b38db4f0db48cf8187e84f37a => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:04.867620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.904414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 131/264] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:04.911043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:04.921495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:05.039753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d5641-d0d1-42c1-8939-a763405225db None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:05.076535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:05.077400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.077673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.077938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.079119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:05.080712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:05.082723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 132/265] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:05.085206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:05.088455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:05.099684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f93593-e80d-4b37-922f-437c9f188c46 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:05.161200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:05.161785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.162070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.162352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.174618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:05.202862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b526-e238-45eb-ad0f-4a7c107af306 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:05.243364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:05.244101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.244383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.244752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.245701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] RBAC: Adding query filter params (role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=cd93ac5b38db4f0db48cf8187e84f37a) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:05.246013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:05.247538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:05.254374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 133/266] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:05 2022] GET /identity/v3/role_assignments?user.id=cd93ac5b38db4f0db48cf8187e84f37a&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:05.283312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:05.284902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:05.426033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:05.437221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 134/267] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:05.443024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:05.560408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ecac9-6b14-43fc-bfde-517520308c39 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:05.596602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17c67-2985-4c7d-a854-b8e3612f881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:05.597495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17c67-2985-4c7d-a854-b8e3612f881b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.597770 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17c67-2985-4c7d-a854-b8e3612f881b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.598040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17c67-2985-4c7d-a854-b8e3612f881b None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.599248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab17c67-2985-4c7d-a854-b8e3612f881b None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:05.600751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab17c67-2985-4c7d-a854-b8e3612f881b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:05.603172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 134/268] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:05 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:05.609188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:05.720444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243eca6-5423-4d5b-8cd7-4fd02bd12e0c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:05.760913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:05.761731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.761945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.762258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.763103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=cd93ac5b38db4f0db48cf8187e84f37a) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:05.763413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:05.764880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e02c58-ebea-4fff-bc43-92c28d777292 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:05.776918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 135/269] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:05 2022] GET /identity/v3/role_assignments?user.id=cd93ac5b38db4f0db48cf8187e84f37a&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:05.876187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9530-b7ae-425a-847c-4fe91fdb3462 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.876466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9530-b7ae-425a-847c-4fe91fdb3462 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.876967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9530-b7ae-425a-847c-4fe91fdb3462 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.878577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 135/270] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:05.884103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.885062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.885529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.911517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:05.913184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:05.925664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843d7d-084f-426b-be07-c258a92feb7b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.925995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843d7d-084f-426b-be07-c258a92feb7b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.926197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843d7d-084f-426b-be07-c258a92feb7b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.928844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 136/271] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:05.934147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:05.934493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:05.934768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:05.951678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:05.962066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:05.965567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:06.008901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.028981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 136/272] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:06.063303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.078162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 137/273] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:06.107948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.187571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071b00e-f318-415d-ae6b-493a4d43f2fd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.229782 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.230947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.231362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922c749-3203-439c-a6f9-b1dc5a687718 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.231727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.232219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.244193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:06.252582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:06.253451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:06.254202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:06.256871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:06.267428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.274121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.274931 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.275207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.275478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.278439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.287409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:06.295552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:06.296444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:06.297217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:06.303447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.327760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.402013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba6c1-049e-402a-9c86-c22db0ded5f1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.428177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ac95-290b-4be4-9c50-78e9e4bc4837 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.447529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.448240 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.448525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.448800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.449589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:06.450429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.452167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.464160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 138/276] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:06.464908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.465595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.465878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.466153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.466912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:06.467220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.478651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.478824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.481575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 139/277] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:06.486990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.576340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.576802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a0dd-5f45-47f4-9ea1-1b6598cd7557 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.587889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.590313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0dd86-754d-459e-adb7-c0252e2da536 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.616817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.618181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.618610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.619019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] PATH_INFO: `/v3/users/e7fdb9e8e56d4b4cb938eadec02dbd67` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.632351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30893c-b304-4492-b194-d1ee283195c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.633310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30893c-b304-4492-b194-d1ee283195c8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.633593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30893c-b304-4492-b194-d1ee283195c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.633869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30893c-b304-4492-b194-d1ee283195c8 None admin] PATH_INFO: `/v3/users/2ec3b7064c564aa19605cbae7ce60717` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.635067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30893c-b304-4492-b194-d1ee283195c8 None admin] RBAC: Authorizing `identity:get_user(user_id=2ec3b7064c564aa19605cbae7ce60717)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.635820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e7fdb9e8e56d4b4cb938eadec02dbd67)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.636560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30893c-b304-4492-b194-d1ee283195c8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.637630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.638208 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 140/278] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/users/2ec3b7064c564aa19605cbae7ce60717 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:06.644075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 139/279] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/users/e7fdb9e8e56d4b4cb938eadec02dbd67 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:06.644206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07efa6-b01f-4397-ae0a-10df22e9c0e1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.644206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07efa6-b01f-4397-ae0a-10df22e9c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.644992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07efa6-b01f-4397-ae0a-10df22e9c0e1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.645512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.645928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 141/280] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:06.646502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07efa6-b01f-4397-ae0a-10df22e9c0e1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.748867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07efa6-b01f-4397-ae0a-10df22e9c0e1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.749864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fd0e-7bb4-4808-bdff-c67ee26018e2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.774258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.783908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1edfb8-ee36-41e7-8304-ebf9f2070214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.784206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.784780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1edfb8-ee36-41e7-8304-ebf9f2070214 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.784894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.785059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1edfb8-ee36-41e7-8304-ebf9f2070214 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.785144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.785330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1edfb8-ee36-41e7-8304-ebf9f2070214 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.785415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.786235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, user.id=e7fdb9e8e56d4b4cb938eadec02dbd67, scope.system=all) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:06.786516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1edfb8-ee36-41e7-8304-ebf9f2070214 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.786601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.787997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1edfb8-ee36-41e7-8304-ebf9f2070214 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.788086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b6c9-98fe-4242-98cf-dbdb8d4d15b7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.789952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 140/281] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:06.790918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e847-52b0-4c29-bf48-452d4895b66a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.791194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e847-52b0-4c29-bf48-452d4895b66a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.791464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e847-52b0-4c29-bf48-452d4895b66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.795899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 142/282] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/role_assignments?user.id=e7fdb9e8e56d4b4cb938eadec02dbd67&scope.system=all&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:06.795899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8be7f-4d07-468e-9942-5234e9448b15 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.795899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8be7f-4d07-468e-9942-5234e9448b15 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.795899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8be7f-4d07-468e-9942-5234e9448b15 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.796786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 143/283] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:06.797484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8be7f-4d07-468e-9942-5234e9448b15 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:06.816889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ad46e847-52b0-4c29-bf48-452d4895b66a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:06.818125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad46e847-52b0-4c29-bf48-452d4895b66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:06.856343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:06.912042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 141/284] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:06.913586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.913956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.914241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.918940 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8be7f-4d07-468e-9942-5234e9448b15 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:06.942637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:06.943837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:06.965393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:06.966302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:06.966589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:06.966865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/2ec3b7064c564aa19605cbae7ce60717/roles/b0d398ede9464d9f93d9f74f83d54b84` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:06.969253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9932c8860f4ad881a95e4095cda755, user_id=2ec3b7064c564aa19605cbae7ce60717, role_id=b0d398ede9464d9f93d9f74f83d54b84)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:06.970960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:06.986560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 144/285] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:06 2022] PUT /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755/users/2ec3b7064c564aa19605cbae7ce60717/roles/b0d398ede9464d9f93d9f74f83d54b84 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:06.996296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:07.016480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 142/286] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:07.039193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:07.060427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:07.118612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6767f-2e72-4bc9-b0bb-ec85fb4da048 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:07.143030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:07.150687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d64d9-3eb6-43cb-a3f9-98104d05c8f3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:07.177760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:07.178622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:07.178902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:07.179171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:07.180710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:07.182021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:07.183660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:07.189043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:07.199650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:07.200667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:07.201052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:07.201788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:07.215119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:07.224738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:07.225807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:07.226821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:07.228511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 143/288] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:07.236863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:07.301480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4f035-f2a7-4823-b84c-516e0425feaf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:07.319141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:07.336661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:07.337497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:07.337874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:07.338238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:07.339053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:07.340614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:07.349472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ea1f-86e3-4c32-8bb9-5762b4dabb83 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:07.368797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 146/289] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:07 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:07.393314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:07.394261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:07.394685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:07.395093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:07.396029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:07.396502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:07.398124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:07.408487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 144/290] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:07.419816 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:07.536817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7cef-cde3-4a07-aa7a-e3d0db9858dc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:07.577174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:07.578450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:07.578924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:07.579390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] PATH_INFO: `/v3/users/00210df8112748f8b505b14873bdea09` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:07.580940 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] RBAC: Authorizing `identity:get_user(user_id=00210df8112748f8b505b14873bdea09)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:07.582664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:07.584901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 147/291] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:07 2022] GET /identity/v3/users/00210df8112748f8b505b14873bdea09 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:07.590662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:07.611966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:07.703743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8ef5f-e432-4456-a49a-ca87cd044124 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:07.740443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:07.741332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:07.741749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:07.742216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:07.811120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:07.812928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:07.840208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:07.934732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 06:57:07.940065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:08.011558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:08.089150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e62b-494f-496f-a02c-ad4dc39c7301 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:08.137753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211953c-275c-4942-b9bb-076228522251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:08.138630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211953c-275c-4942-b9bb-076228522251 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:08.138911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211953c-275c-4942-b9bb-076228522251 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:08.139186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211953c-275c-4942-b9bb-076228522251 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:08.140404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211953c-275c-4942-b9bb-076228522251 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:08.141864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211953c-275c-4942-b9bb-076228522251 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:08.143788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 148/293] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:07 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:08.149551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:08.253779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8354a-d9a6-4e1b-ad75-efe38c2534e2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:08.271808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:08.289053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:08.289739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:08.290020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:08.290297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:08.291156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=00210df8112748f8b505b14873bdea09) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:08.291477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:08.292999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40883-83b4-46f8-a21c-ea6bb321b4cb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:08.300235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 146/294] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:08 2022] GET /identity/v3/role_assignments?user.id=00210df8112748f8b505b14873bdea09&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:08.968251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe44493-5bcd-4030-8462-ca81feb7f069 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:08.968657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe44493-5bcd-4030-8462-ca81feb7f069 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:08.968830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe44493-5bcd-4030-8462-ca81feb7f069 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:08.970458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 149/295] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:08.975959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:08.976856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:08.977356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:08.994532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:08.995992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:09.064920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:09.089667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe44493-5bcd-4030-8462-ca81feb7f069 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.198289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe44493-5bcd-4030-8462-ca81feb7f069 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:09.210168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:09.236586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7c02-c93d-431c-8cd8-364a4e067070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:09.237760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7c02-c93d-431c-8cd8-364a4e067070 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.238272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7c02-c93d-431c-8cd8-364a4e067070 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.238733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7c02-c93d-431c-8cd8-364a4e067070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.249600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7c02-c93d-431c-8cd8-364a4e067070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-16ae7c02-c93d-431c-8cd8-364a4e067070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:09.257834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:09.258682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:09.259459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:09.262153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 150/297] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:09.268312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.365647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6605f47-0d90-424f-8612-180eb57e71bf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:09.377564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de6c6-ef38-4b08-8dbd-4365d4cea594 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.377852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de6c6-ef38-4b08-8dbd-4365d4cea594 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.378123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de6c6-ef38-4b08-8dbd-4365d4cea594 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.379496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 151/298] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:09.387679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.387986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.388258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.390348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:09.405301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:09.406642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:09.412041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:09.412730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.413016 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.413298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.414098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:09.414413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:09.415804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:09.424624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 148/299] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:09.430715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.481519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 152/300] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:09.505224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.552659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715a73-d5e6-4475-a6f3-9dea6efe09a6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:09.600050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:09.601089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.601408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.601988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] PATH_INFO: `/v3/users/e7fdb9e8e56d4b4cb938eadec02dbd67` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.603689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=e7fdb9e8e56d4b4cb938eadec02dbd67)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:09.605648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:09.607698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 149/301] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/users/e7fdb9e8e56d4b4cb938eadec02dbd67 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:09.612200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:09.613524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.615280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4085a-36ca-4251-aecf-0dccfbe6f089 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:09.652628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:09.653675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.654124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.654587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.658795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:09.666590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:09.674974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:09.676055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:09.677007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:09.678894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 153/302] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:09.684844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.719685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5163d-02a4-450d-a729-77371ac69ac5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:09.755426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180e3ba-ab15-49dd-8e67-0ec8b44ff4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:09.756387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180e3ba-ab15-49dd-8e67-0ec8b44ff4c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.756667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180e3ba-ab15-49dd-8e67-0ec8b44ff4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.756940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180e3ba-ab15-49dd-8e67-0ec8b44ff4c0 None admin] PATH_INFO: `/v3/system/users/e7fdb9e8e56d4b4cb938eadec02dbd67/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.758689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180e3ba-ab15-49dd-8e67-0ec8b44ff4c0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7fdb9e8e56d4b4cb938eadec02dbd67, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:09.759881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180e3ba-ab15-49dd-8e67-0ec8b44ff4c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:09.770682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 150/303] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Jun 24 06:57:09 2022] PUT /identity/v3/system/users/e7fdb9e8e56d4b4cb938eadec02dbd67/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 06:57:09.772051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51355d6a-10f2-47ce-b224-1712845ba400 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.772358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51355d6a-10f2-47ce-b224-1712845ba400 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.772627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51355d6a-10f2-47ce-b224-1712845ba400 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.775902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 151/304] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:09.779894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.780189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.780464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.798506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:09.799915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:09.807293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80bae-87b5-48e6-9bf9-e77496aba194 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:09.855382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046e424-772c-4309-a938-737db122b23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:09.856726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046e424-772c-4309-a938-737db122b23d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:09.857231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046e424-772c-4309-a938-737db122b23d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:09.857859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046e424-772c-4309-a938-737db122b23d None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:09.859263 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046e424-772c-4309-a938-737db122b23d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:09.859809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046e424-772c-4309-a938-737db122b23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:09.861532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046e424-772c-4309-a938-737db122b23d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:09.875459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 154/305] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:09.881104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046e424-772c-4309-a938-737db122b23d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.883972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 152/306] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:09.910867 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:09.920305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:09.956769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.005018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046e424-772c-4309-a938-737db122b23d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.034706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962647d-0714-4772-997d-01dd1c381ab5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.040982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51347919-4a57-4066-bfc8-1fa635fc822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.041876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51347919-4a57-4066-bfc8-1fa635fc822d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.042160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51347919-4a57-4066-bfc8-1fa635fc822d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.042910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51347919-4a57-4066-bfc8-1fa635fc822d None admin] PATH_INFO: `/v3/users/2ec3b7064c564aa19605cbae7ce60717` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.044158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51347919-4a57-4066-bfc8-1fa635fc822d None admin] RBAC: Authorizing `identity:get_user(user_id=2ec3b7064c564aa19605cbae7ce60717)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.046289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51347919-4a57-4066-bfc8-1fa635fc822d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.048122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 155/307] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/users/2ec3b7064c564aa19605cbae7ce60717 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:10.049311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1797e-a020-43fd-ae4c-e0fbf125d040 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.049599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1797e-a020-43fd-ae4c-e0fbf125d040 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.049875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1797e-a020-43fd-ae4c-e0fbf125d040 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.051216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 156/308] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:10.055819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1797e-a020-43fd-ae4c-e0fbf125d040 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.076456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336546e-8c89-4d20-b756-c4c24de0d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.077282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336546e-8c89-4d20-b756-c4c24de0d400 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.077566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336546e-8c89-4d20-b756-c4c24de0d400 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.077841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336546e-8c89-4d20-b756-c4c24de0d400 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.088866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336546e-8c89-4d20-b756-c4c24de0d400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-5336546e-8c89-4d20-b756-c4c24de0d400 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:10.098840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:10.099725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:10.101492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 153/309] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:10.102139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.102139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.102263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.120183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:10.121385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:10.161213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.173537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1797e-a020-43fd-ae4c-e0fbf125d040 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.193575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 154/310] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:10.194424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.214849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.217486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.217793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.218072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.235164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.296995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.298461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.323178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdacc7f-164a-4a15-befe-a3ef6f07994b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.359573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.360380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.360652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.360934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.361785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:10.362094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.363582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.377798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 155/311] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:10.377798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.400490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.411652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 157/312] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:10.412666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.473909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.487566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e796f-1625-45b0-a7fb-fbab02a0d233 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.516175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490e8cb-c6b1-4cdb-93a2-e56dd6737290 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.522254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.523145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.523505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.523875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.525544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.527440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.533935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 156/313] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:10.533935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.559065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.560240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.560550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.560795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] PATH_INFO: `/v3/users/dc3d4290d7e340d5887fe49a49f79cf6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.574544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] RBAC: Authorizing `identity:get_user(user_id=dc3d4290d7e340d5887fe49a49f79cf6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.576067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.577978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 158/314] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/users/dc3d4290d7e340d5887fe49a49f79cf6 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:10.580654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.629972 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.635239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a62d8-9833-42a1-b39a-64a0d29d636d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.670001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.670958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.671312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.671665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.672936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.674451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.676446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 157/315] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:10.677169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.686285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf98f2-0f83-46dd-9819-fd812dafc64f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.703649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.720191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.720996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.721376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.721750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] PATH_INFO: `/v3/groups` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.722565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.724134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.740243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 159/316] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Jun 24 06:57:10 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:10.741074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:10.820076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3f6f-7e0f-4614-a412-b6dceb6fcdd8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.863466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.864425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.864864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.865327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.866073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c610a3-d994-470e-9180-626fc22b371a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:10.866514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] RBAC: Adding query filter params (role.id=b0d398ede9464d9f93d9f74f83d54b84, user.id=dc3d4290d7e340d5887fe49a49f79cf6, scope.system=all) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:10.867038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.868803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910d492-9677-44f0-8501-56350d021fe2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.877630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:10.880246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 158/317] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/role_assignments?user.id=dc3d4290d7e340d5887fe49a49f79cf6&scope.system=all&role.id=b0d398ede9464d9f93d9f74f83d54b84 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:10.915835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:10.916855 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:10.917330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:10.917800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:10.918845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] RBAC: Adding query filter params (role.id=b0d398ede9464d9f93d9f74f83d54b84, scope.project.id=ae9932c8860f4ad881a95e4095cda755, user.id=2ec3b7064c564aa19605cbae7ce60717) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:10.919153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:10.920696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa8a04-97e8-4cc9-8cf9-a6bb0a0fe830 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:10.927957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 160/318] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:10 2022] GET /identity/v3/role_assignments?user.id=2ec3b7064c564aa19605cbae7ce60717&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=b0d398ede9464d9f93d9f74f83d54b84 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:11.807046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d41360-bf03-4ea1-81cf-8a6dbbd399a2 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:11.807638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d41360-bf03-4ea1-81cf-8a6dbbd399a2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:11.807638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d41360-bf03-4ea1-81cf-8a6dbbd399a2 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:11.809201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 159/319] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:11.814206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:11.814612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:11.814776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:11.832307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:11.833474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:11.904226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 161/320] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:11.926979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d41360-bf03-4ea1-81cf-8a6dbbd399a2 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:12.020189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:12.034530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d41360-bf03-4ea1-81cf-8a6dbbd399a2 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:12.067754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:12.068508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.068785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.069054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.081168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:12.089553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:12.090402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:12.091190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:12.095572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 160/321] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:12.096489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:12.196832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66184598-21ce-4148-bc3a-f0615927b1dc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:12.198315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:12.232168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:12.232831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.233107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.233378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.234128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:12.234430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:12.235796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:12.244377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 162/322] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:12.249671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:12.350421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbb6a-b6de-4a17-a661-8da19a5eb362 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:12.390520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c5423-a5d2-4d00-9492-7a44626b3ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:12.391408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c5423-a5d2-4d00-9492-7a44626b3ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.391685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c5423-a5d2-4d00-9492-7a44626b3ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.391989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c5423-a5d2-4d00-9492-7a44626b3ca5 None admin] PATH_INFO: `/v3/users/e7fdb9e8e56d4b4cb938eadec02dbd67` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.393220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c5423-a5d2-4d00-9492-7a44626b3ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=e7fdb9e8e56d4b4cb938eadec02dbd67)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:12.394665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c5423-a5d2-4d00-9492-7a44626b3ca5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:12.396492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 161/323] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:12 2022] GET /identity/v3/users/e7fdb9e8e56d4b4cb938eadec02dbd67 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:12.402140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:12.502435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c78884-b84c-4a2e-80a6-c5b744303072 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:12.536669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:12.537330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.537611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.537884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.538710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] RBAC: Adding query filter params (role.id=658e15b437f34e58aaffdfdd2f52944e, user.id=e7fdb9e8e56d4b4cb938eadec02dbd67, scope.system=all) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:12.539047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:12.540514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f6154-3a09-49f3-99a6-66acc45102cf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:12.553228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 163/324] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jun 24 06:57:12 2022] GET /identity/v3/role_assignments?user.id=e7fdb9e8e56d4b4cb938eadec02dbd67&scope.system=all&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 510 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:12.810656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be5da-761a-4882-a394-c44d0e40e895 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.811186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be5da-761a-4882-a394-c44d0e40e895 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.811186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be5da-761a-4882-a394-c44d0e40e895 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.812689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 162/325] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:12.818089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.818508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.818649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.835881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:12.837065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:12.854398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:12.896067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bccb29-fb61-4807-a275-224a8015c159 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.896327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bccb29-fb61-4807-a275-224a8015c159 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.896602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bccb29-fb61-4807-a275-224a8015c159 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.897991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 163/326] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:12.902925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:12.903206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:12.903480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:12.907089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 164/327] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:12.920730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:12.921902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:12.930043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:12.933217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:12.991498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 164/328] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:13.014050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:13.029632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ef466-ed16-4780-b029-303f25f932ee None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:13.063161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:13.063928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:13.064211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:13.064483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:13.065683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:13.067168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:13.073413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 165/329] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:13.074358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:13.096176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:13.113076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d8854-9144-4c5a-aaef-3ac635ee514c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:13.147883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:13.148786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:13.149068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:13.149346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:13.160029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:13.167898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:13.168765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:13.169539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 165/330] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:13.175020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:13.175134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e21b2-1ef1-421b-8459-75fc7115a231 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:13.183712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:13.210763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:13.211433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:13.211717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:13.212026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] PATH_INFO: `/v3/groups` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:13.212726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:13.214167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:13.228699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 166/331] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Jun 24 06:57:13 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:13.281291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13160f50-8270-4447-86a6-0fa0b1be5344 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:13.318652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:13.319281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:13.319604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:13.319828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:13.320702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:13.320961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:13.322378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:13.331726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 166/332] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:13.337862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:13.430107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:13.452228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498129-49e5-46a9-8386-adc5b432d299 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:13.487548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3290f-84fd-4613-9b26-4216756956da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:13.488501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3290f-84fd-4613-9b26-4216756956da None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:13.488783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3290f-84fd-4613-9b26-4216756956da None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:13.489055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3290f-84fd-4613-9b26-4216756956da None admin] PATH_INFO: `/v3/users/dc3d4290d7e340d5887fe49a49f79cf6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:13.490256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3290f-84fd-4613-9b26-4216756956da None admin] RBAC: Authorizing `identity:get_user(user_id=dc3d4290d7e340d5887fe49a49f79cf6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:13.491729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3290f-84fd-4613-9b26-4216756956da None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:13.493440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 167/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:13 2022] GET /identity/v3/users/dc3d4290d7e340d5887fe49a49f79cf6 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:13.499212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:13.576064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:13.615117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a05c9-32ea-4bd9-b018-84fd3b07d272 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:13.655039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c1a8-5356-420f-bc9e-1e91302df106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:13.655952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c1a8-5356-420f-bc9e-1e91302df106 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:13.656237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c1a8-5356-420f-bc9e-1e91302df106 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:13.656510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c1a8-5356-420f-bc9e-1e91302df106 None admin] PATH_INFO: `/v3/system/users/dc3d4290d7e340d5887fe49a49f79cf6/roles/b0d398ede9464d9f93d9f74f83d54b84` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:13.658007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c1a8-5356-420f-bc9e-1e91302df106 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc3d4290d7e340d5887fe49a49f79cf6, role_id=b0d398ede9464d9f93d9f74f83d54b84)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:13.659390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c1a8-5356-420f-bc9e-1e91302df106 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:13.670209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 167/334] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Jun 24 06:57:13 2022] PUT /identity/v3/system/users/dc3d4290d7e340d5887fe49a49f79cf6/roles/b0d398ede9464d9f93d9f74f83d54b84 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:15.779305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fe557-718f-4221-9dcf-fa3f01092c3a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:15.780258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fe557-718f-4221-9dcf-fa3f01092c3a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:15.780746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fe557-718f-4221-9dcf-fa3f01092c3a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:15.782326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 168/335] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:15.788003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b960-14ad-4900-b302-84279c40a620 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:15.788926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b960-14ad-4900-b302-84279c40a620 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:15.789337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b960-14ad-4900-b302-84279c40a620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:15.808140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5b90b960-14ad-4900-b302-84279c40a620 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:15.809329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5b90b960-14ad-4900-b302-84279c40a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:15.898517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 168/336] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:15.945450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fe557-718f-4221-9dcf-fa3f01092c3a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:15.959964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d575b-478b-4297-bdc8-e79c1ad9655c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:15.960278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d575b-478b-4297-bdc8-e79c1ad9655c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:15.960569 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d575b-478b-4297-bdc8-e79c1ad9655c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:15.962222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 169/337] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:15.968216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755cd1-fcbc-4aa3-b4a5-1f5c434be222 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:15.968797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755cd1-fcbc-4aa3-b4a5-1f5c434be222 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:15.969082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755cd1-fcbc-4aa3-b4a5-1f5c434be222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:15.993860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ab755cd1-fcbc-4aa3-b4a5-1f5c434be222 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:15.995047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab755cd1-fcbc-4aa3-b4a5-1f5c434be222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:16.116254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:16.136618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 170/338] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:16.150787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fe557-718f-4221-9dcf-fa3f01092c3a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.177191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb197-47c7-48f7-aaba-15222708ebcf None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.177496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb197-47c7-48f7-aaba-15222708ebcf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.177744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb197-47c7-48f7-aaba-15222708ebcf None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.179125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 171/339] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:16.184333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb197-47c7-48f7-aaba-15222708ebcf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.216573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bff8d2-4241-4715-98bb-3c954038586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.217402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff8d2-4241-4715-98bb-3c954038586e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.217687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff8d2-4241-4715-98bb-3c954038586e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.217962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff8d2-4241-4715-98bb-3c954038586e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.238359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bff8d2-4241-4715-98bb-3c954038586e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a2bff8d2-4241-4715-98bb-3c954038586e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:16.247253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:16.248161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:16.248932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 169/340] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:16.251877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b76d-5aa8-4ac5-8f70-6891e1e04bce None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.251877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b76d-5aa8-4ac5-8f70-6891e1e04bce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.251877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b76d-5aa8-4ac5-8f70-6891e1e04bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.268697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c697b76d-5aa8-4ac5-8f70-6891e1e04bce None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:16.269887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c697b76d-5aa8-4ac5-8f70-6891e1e04bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:16.271930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:16.302276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb197-47c7-48f7-aaba-15222708ebcf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.341922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d4e01-e52b-4097-96fb-866763b10ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.342739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4e01-e52b-4097-96fb-866763b10ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.343089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4e01-e52b-4097-96fb-866763b10ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.343291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d4e01-e52b-4097-96fb-866763b10ea1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.345708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 170/341] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:16.347206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1166528-81c4-45a3-ac73-630ec9d899c7 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.347497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1166528-81c4-45a3-ac73-630ec9d899c7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.347775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1166528-81c4-45a3-ac73-630ec9d899c7 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.349077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 171/342] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:16.349817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1166528-81c4-45a3-ac73-630ec9d899c7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.355211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d4e01-e52b-4097-96fb-866763b10ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-300d4e01-e52b-4097-96fb-866763b10ea1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:16.363282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:16.365356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 172/343] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:16.367367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.369084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.369084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.398315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:16.400902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:16.472351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:16.487710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 173/344] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:16.488950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.502135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1166528-81c4-45a3-ac73-630ec9d899c7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.547891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.549111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.549556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.550147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.551347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:16.551803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:16.553370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:16.560756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:16.569196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 172/345] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:16.569196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.637371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42104-c0f1-4847-9b02-622586284baf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.684225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.684739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24f722-d60b-4f53-bdd7-0f7c184f854b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.685338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.685763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.686179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.687352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:16.688721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:16.690316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:16.702035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 174/346] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:16.703159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.733886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.734906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.735351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.735651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.748858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:16.758099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:16.759244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:16.760301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:16.762336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 173/347] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:16.765080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:16.767538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.838549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86acce5-1c6b-476f-813e-a10a5f58c9c6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.840910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:16.887454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.887975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f80b3-09d4-4394-8aac-c8dcbe72da20 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:16.888696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.889123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.889585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:16.903654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:16.914147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:16.915343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:16.916359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:16.919033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 175/348] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:16.920711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:16.935107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:16.936203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:16.936588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:16.936963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.018203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.019938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.048913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e7e7-a4b1-4f69-b832-aca0b01859f4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.052662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.091332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.092482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.092771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.093099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] PATH_INFO: `/v3/users/dc3d4290d7e340d5887fe49a49f79cf6` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.094317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] RBAC: Authorizing `identity:get_user(user_id=dc3d4290d7e340d5887fe49a49f79cf6)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.095826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.097773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 176/349] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/users/dc3d4290d7e340d5887fe49a49f79cf6 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:17.102098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.104585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.161831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 174/350] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:17.163281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.227111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9ba7f-60a6-4fc2-873e-8467c34bfad6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.271491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.272249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.272530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.272805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.273616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:17.274048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.275539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.286875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 177/351] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:17.288549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.290902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980e74-a907-45e7-8724-ca9f70ad6743 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.334256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.337538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.338231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.338510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.338817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.339578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:17.339986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.341375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.352990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 175/352] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:17.353894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.381749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.413955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a433-2bbd-41f8-b60a-ac6008786599 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.457384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.458273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.458698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.459067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.460328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] RBAC: Adding query filter params (role.id=b0d398ede9464d9f93d9f74f83d54b84, user.id=dc3d4290d7e340d5887fe49a49f79cf6, scope.system=all) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:17.460703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.463321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fca60-8b24-478b-ab57-45b490490060 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.476550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede74cb-3bb1-43f9-8b9d-7b282b99244a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.478611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 178/353] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/role_assignments?user.id=dc3d4290d7e340d5887fe49a49f79cf6&scope.system=all&role.id=b0d398ede9464d9f93d9f74f83d54b84 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:17.480133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93a4d-3e9e-4cf7-bd35-02ebcf81c333 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.480570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93a4d-3e9e-4cf7-bd35-02ebcf81c333 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.480985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93a4d-3e9e-4cf7-bd35-02ebcf81c333 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.482458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 179/354] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:17.487435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e93a4d-3e9e-4cf7-bd35-02ebcf81c333 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.525612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.526629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.526909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.528221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.530154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.532073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.534602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 176/355] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:17.535637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.636215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.656479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e93a4d-3e9e-4cf7-bd35-02ebcf81c333 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.677450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.691890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6396156-58de-4e2d-ac0b-6e648fd66e0c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:17.700761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c140cc-2cfc-410d-bf08-fbee7173038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.700761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c140cc-2cfc-410d-bf08-fbee7173038f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.701037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c140cc-2cfc-410d-bf08-fbee7173038f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.701118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c140cc-2cfc-410d-bf08-fbee7173038f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.736179 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:17.736834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.737111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.737383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.782222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c140cc-2cfc-410d-bf08-fbee7173038f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.783716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c140cc-2cfc-410d-bf08-fbee7173038f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.820643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:17.822132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:17.886285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.897117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 180/356] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:17.898519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745b4c-b3ff-4e63-87ad-d9f489dc7691 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.898734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745b4c-b3ff-4e63-87ad-d9f489dc7691 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.899011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745b4c-b3ff-4e63-87ad-d9f489dc7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.921334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-09745b4c-b3ff-4e63-87ad-d9f489dc7691 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:17.922824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-09745b4c-b3ff-4e63-87ad-d9f489dc7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:17.925448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:17.942492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 177/357] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:17.943812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:17.998130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 181/358] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:17.998130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4baf7-4700-4b46-988d-63e678a3bddb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:17.998130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4baf7-4700-4b46-988d-63e678a3bddb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:17.998130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4baf7-4700-4b46-988d-63e678a3bddb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:17.998523 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 182/359] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:17.999146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4baf7-4700-4b46-988d-63e678a3bddb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.072066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4cd81-f55d-44eb-aed3-6da9a1fb1af1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.112140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.113015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.116003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.116003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.121704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.123186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.124962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 178/360] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.125862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.128098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4baf7-4700-4b46-988d-63e678a3bddb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.158508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:18.174833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43495a-a283-4fee-8c83-0605379f4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.175816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43495a-a283-4fee-8c83-0605379f4a5c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.176315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43495a-a283-4fee-8c83-0605379f4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.176562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43495a-a283-4fee-8c83-0605379f4a5c None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.177697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43495a-a283-4fee-8c83-0605379f4a5c None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.179142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43495a-a283-4fee-8c83-0605379f4a5c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.181841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 183/361] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:17 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.183011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.183293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.183624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.189370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:18.202788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:18.203975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:18.242054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581bd15-6949-435d-8312-0365374eb944 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.280631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.281602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.281884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.282154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.283350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.284820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.286519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 179/362] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.287908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.289503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 184/363] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:18.290283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.407465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f453ffe-2558-4640-b35a-c15b8fac2824 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.423642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4130c4-d34d-4498-bef2-1db0701de397 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.430685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:18.446453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.447117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.447400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.447674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.448596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=747035f4f8d34d9b99f97b83ce23e619) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:18.448909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.450368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.450790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:18.459496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 185/364] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.459496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.466033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.466876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.467163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.467433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.484120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:18.493630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:18.494647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:18.495499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 180/365] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:18.497847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.596295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593af3-a3b4-4448-a77c-20995f9af966 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.636442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.637346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.637628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.637899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.640934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.641509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.643101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12fd2f-0672-4f73-9220-8fbf70473c1c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.643530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 186/366] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.644482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.696482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.697634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.697924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.698181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.699486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.701119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.702930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 181/367] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.703923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:18.704944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.767828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:18.772840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f69e-f27a-41fa-a4e2-253830f2163e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.816896 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.818023 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.818366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.818706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.831514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:18.834055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1fc6a-7cf6-4ce7-b113-91f6c6e2ff26 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:18.839601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:18.840516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:18.841286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:18.841858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 187/368] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:18.842600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.885226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:18.886285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:18.886792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:18.887075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:18.887942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:18.888296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:18.889695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:18.899691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 182/369] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:18.901519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:18.976550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e2833-d8c7-494e-bf26-513c530ab74d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:18.991439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:19.023820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:19.024466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:19.024754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:19.025033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:19.025882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=747035f4f8d34d9b99f97b83ce23e619) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:19.026197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:19.027658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:19.035402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 188/370] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:19.036849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:19.039666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8604a-297e-44d1-b3ac-2eafab9b8128 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:19.057900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:19.089461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:19.090392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:19.093105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:19.093105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:19.093105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=ae9932c8860f4ad881a95e4095cda755) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:19.093105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:19.097270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:19.106285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 183/371] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:18 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:19.107590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:19.210372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3995-89bf-4ccb-b65d-28b93721e10f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:19.254681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:19.255390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:19.255674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:19.255974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:19.256761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:19.257794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:19.259487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:19.270814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 189/372] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:19.276744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:19.315641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835abbb-97ef-46f1-8f37-1260cb638455 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:19.330870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:19.355204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:19.355889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:19.356181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:19.356455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:19.440200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:19.454889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac69c0-21f3-415b-929e-c136221c7381 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:19.496160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:19.497632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:19.500530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:19.501198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:19.501480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:19.501760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:19.611247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:19.612758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:19.676241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:19.684444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 184/373] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:19.690533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:19.782291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:19.808960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 190/374] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:19.817259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:19.820289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb137-9b1b-4554-9027-940b77261f98 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:19.947882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:19.952815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:19.953253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:19.953775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:19.958261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:19.959922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:19.970117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 185/375] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:19 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:19.971252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:20.171085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84e54-9212-431c-8fca-7043208c368e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:20.288844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:20.290020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.290435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.290859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] PATH_INFO: `/v3/projects/380a960ee385491dbc55afab2693ac72` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.296590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] RBAC: Authorizing `identity:get_project(project_id=380a960ee385491dbc55afab2693ac72)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:20.297949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9fe80-e26a-4bee-8c42-85a14723c8bf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:20.298416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:20.300297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 191/376] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:19 2022] GET /identity/v3/projects/380a960ee385491dbc55afab2693ac72 => generated 344 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:20.311295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:20.336484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:20.369310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:20.372082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.374754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.375193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.378022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:20.379659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:20.381799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 186/377] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:19 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:20.387923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:20.426207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:20.473773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef479-bb3b-4656-8b10-a574e264eec5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:20.511572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:20.512470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.512747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.513016 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] PATH_INFO: `/v3/groups/09bff0d0f0c549a6b36fc1ad9d176847` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.528255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] RBAC: Authorizing `identity:get_group(group_id=09bff0d0f0c549a6b36fc1ad9d176847)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:20.529711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:20.531382 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 192/378] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:20 2022] GET /identity/v3/groups/09bff0d0f0c549a6b36fc1ad9d176847 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:20.537618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:20.598823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb160-08c9-4fc8-a26d-5497b25bd613 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:20.651790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:20.653961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:20.654788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.655078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.663986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.664933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=ae9932c8860f4ad881a95e4095cda755) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:20.665262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:20.666727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cab3f3-b3fd-45c4-b21d-b1dcb7caf22f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:20.681761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 187/379] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:20 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:20.689261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c71e-4bb5-429a-bcff-65cd7f6311ba None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:20.727934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:20.728621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.728904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.729178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.730044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] RBAC: Adding query filter params (group.id=09bff0d0f0c549a6b36fc1ad9d176847, role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=380a960ee385491dbc55afab2693ac72) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:20.730358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:20.731895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4591-c8b1-4ccc-adf1-0a9a4f2a38d5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:20.739556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 193/380] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:20 2022] GET /identity/v3/role_assignments?group.id=09bff0d0f0c549a6b36fc1ad9d176847&scope.project.id=380a960ee385491dbc55afab2693ac72&role.id=c55009d9dd08464ebde7f96db3459dea => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:20.803685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb21cc-3ddf-4914-99d4-49773a7d1676 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.804541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb21cc-3ddf-4914-99d4-49773a7d1676 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.805029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb21cc-3ddf-4914-99d4-49773a7d1676 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.806949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 188/381] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:20.812665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:20.812956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:20.813227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:20.839917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:20.841183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:20.938002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 194/382] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:20.961354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb21cc-3ddf-4914-99d4-49773a7d1676 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.065912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:21.097533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb21cc-3ddf-4914-99d4-49773a7d1676 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:21.138182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:21.139031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.139315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.139587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.150383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:21.158439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:21.159305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:21.160129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:21.163968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 189/383] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:21.166219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.270160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:21.313336 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043c80-67b8-44dc-a7df-bd453c490e50 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:21.363346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:21.364060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.364349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.364619 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.365371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:21.365678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:21.367139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90401865-999a-4fdd-be24-041c65c44650 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:21.382881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 195/384] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:21.388688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.488157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4bb24-f1cf-48bd-9c74-e89f9c138b72 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.488803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4bb24-f1cf-48bd-9c74-e89f9c138b72 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.489272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4bb24-f1cf-48bd-9c74-e89f9c138b72 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.490835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 196/385] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:21.495923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7dc67-4387-4d30-970a-7d1dd5b65ba5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.496462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7dc67-4387-4d30-970a-7d1dd5b65ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.496930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7dc67-4387-4d30-970a-7d1dd5b65ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.513947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d5b7dc67-4387-4d30-970a-7d1dd5b65ba5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:21.515439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d5b7dc67-4387-4d30-970a-7d1dd5b65ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:21.584028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94925c-6e90-4af7-b35e-46539330b61f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:21.585790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 197/386] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:21.594736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b0dd8-8b8f-4336-a128-76330e475f68 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.595458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b0dd8-8b8f-4336-a128-76330e475f68 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.595946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b0dd8-8b8f-4336-a128-76330e475f68 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.597770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 198/387] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:21.603785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.604318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.604812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.628662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:21.628662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.628662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.628662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.629064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:21.629578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:21.631543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 190/388] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:21 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:21.632547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.633378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:21.634822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:21.636463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:21.692898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:21.712270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 199/389] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:21.713514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.773246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964b84-32a3-48cb-8939-e53db7e1dd72 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:21.820063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:21.821012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.821458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.822012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.827922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8fdb-2ba0-4e0e-aa5b-bb7cdc0b5340 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:21.832954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:21.841348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:21.842191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:21.842992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:21.847656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 191/390] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:21.848631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.866834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:21.868036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:21.868608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:21.869069 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:21.870479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:21.872258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:21.874413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 200/391] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:21 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:21.875352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:21.924138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:21.945960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:21.973056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aaf6d-7f85-4517-9653-fbc6e4ff4cb7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:21.999069 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b26066-b4f3-4fe7-8e7f-df6e7e5052c0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.015590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.017028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.017524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.018000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.038281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.039067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.039349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.039676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.041191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:22.043792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:22.044253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.048984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:22.050811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:22.051741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:22.053053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 192/392] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:22.053676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.062675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 201/393] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:22.063784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.188901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26151-2134-4490-902c-8be5a8808c68 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.204627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9153b1-a0cf-4ae0-97ad-20ade3ae8117 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.211703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:22.236755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:22.238888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.240010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.241138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.242131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.243278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:22.243725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.246152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.249740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.250723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.251101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.251470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619/groups/1fe699112537457798d3281382199740/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.253563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] RBAC: Authorizing `identity:create_grant(project_id=747035f4f8d34d9b99f97b83ce23e619, group_id=1fe699112537457798d3281382199740, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.255089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.256192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 202/394] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:22.257104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.275623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 193/395] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jun 24 06:57:22 2022] PUT /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619/groups/1fe699112537457798d3281382199740/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:22.276909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.376895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d65f-2555-4060-9bfe-a94715dba2fc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.390594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7ae4-0214-42d8-8a13-97a9b61e364d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.424366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.425775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.426239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.426690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.428386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.430320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.430809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.431765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.432200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.432543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.433337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 203/396] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:22 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:22.433893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.435457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.443985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 194/397] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:22 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:22.445655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.446443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.526375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:22.533807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:22.585029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349cb7-5d34-44ca-a9d8-9c7f405e87e4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.587591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53617-9497-4d8b-99f6-b16923140135 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.621580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.622394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.622676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.622999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.624190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.625664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.627751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.628897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.629402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.629887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.631387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.631961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 204/398] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:22 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:22.633391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.633649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.635568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 195/399] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:22 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:22.641265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:22.744502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5b017-1ee0-432c-92c2-aa23f242d551 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.750653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f401f-ea20-493c-bc73-88510b04b3af None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:22.758718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:22.777379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:22.780129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598742a-8046-4033-8856-57ccc03fc4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.781188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598742a-8046-4033-8856-57ccc03fc4a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.781469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598742a-8046-4033-8856-57ccc03fc4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.781744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598742a-8046-4033-8856-57ccc03fc4a6 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755/groups/1fe699112537457798d3281382199740/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.784526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598742a-8046-4033-8856-57ccc03fc4a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9932c8860f4ad881a95e4095cda755, group_id=1fe699112537457798d3281382199740, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.786572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598742a-8046-4033-8856-57ccc03fc4a6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.791403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479b76b-67e4-45e9-817f-477212072e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:22.795944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479b76b-67e4-45e9-817f-477212072e52 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:22.795944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479b76b-67e4-45e9-817f-477212072e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:22.795944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479b76b-67e4-45e9-817f-477212072e52 None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619/groups/1fe699112537457798d3281382199740/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:22.795944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479b76b-67e4-45e9-817f-477212072e52 None admin] RBAC: Authorizing `identity:create_grant(project_id=747035f4f8d34d9b99f97b83ce23e619, group_id=1fe699112537457798d3281382199740, role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:22.797525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479b76b-67e4-45e9-817f-477212072e52 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:22.820537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 205/400] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jun 24 06:57:22 2022] PUT /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755/groups/1fe699112537457798d3281382199740/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:22.820845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 196/401] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jun 24 06:57:22 2022] PUT /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619/groups/1fe699112537457798d3281382199740/roles/90387e9afaca4d41b37d78e341b4e561 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 06:57:23.131606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa37af7-7ba1-4de8-8b6e-bd371ba4d441 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.132007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa37af7-7ba1-4de8-8b6e-bd371ba4d441 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.132226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa37af7-7ba1-4de8-8b6e-bd371ba4d441 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.134014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 206/402] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:23.139377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.139667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.139972 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.161143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:23.162334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:23.212004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba90-3875-46a1-a26c-c2decd6758f0 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.212309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba90-3875-46a1-a26c-c2decd6758f0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.212558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba90-3875-46a1-a26c-c2decd6758f0 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.213982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 207/403] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:23.221015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.221296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.221572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.246277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 197/404] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:23.256882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:23.258163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:23.273249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:23.335079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 208/405] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:23.373859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:23.413114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5cffc-644c-4e00-b89a-5615e0b11637 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:23.425746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:23.470921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:23.472012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.472297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.472566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.493203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:23.508891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:23.509777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:23.510987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 198/406] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:23.517519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:23.517724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faa2df-0aa8-45f1-986f-7b708cc5e748 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:23.520309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:23.554728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:23.555571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.555870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.556153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.566814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:23.575022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:23.575890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:23.576870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 209/407] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:23.582017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:23.713396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb148323-051c-40ef-812e-40e41739d0e1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:23.756376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:23.756725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6292-3102-41dc-a85a-5147d534a93b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:23.757254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.757776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.758145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.759029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:23.759423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:23.760920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:23.770684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 210/408] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:23.776253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:23.805338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:23.837051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:23.838025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.838481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.838985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.840048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:23.840561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:23.842252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:23.863766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 199/409] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:23.873855 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:23.890833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5da1-5170-4824-9fce-406e0774ddf1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:23.924393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:23.925450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:23.925796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:23.926156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] PATH_INFO: `/v3/groups/09bff0d0f0c549a6b36fc1ad9d176847` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:23.927446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] RBAC: Authorizing `identity:get_group(group_id=09bff0d0f0c549a6b36fc1ad9d176847)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:23.929348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:23.931199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 211/410] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/groups/09bff0d0f0c549a6b36fc1ad9d176847 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:23.936586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:23.937797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:24.036341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:24.041158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60f97-a17d-45b7-88ec-ea4db367ebbb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:24.070546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9caf5-6fd8-43e2-b5b1-63dd65665bdc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:24.111701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:24.112649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.113061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.113377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] PATH_INFO: `/v3/projects/380a960ee385491dbc55afab2693ac72` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.114592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] RBAC: Authorizing `identity:get_project(project_id=380a960ee385491dbc55afab2693ac72)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:24.117009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:24.119611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 212/411] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/projects/380a960ee385491dbc55afab2693ac72 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:24.128426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:24.156572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:24.157456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.157736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.158009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.159216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:24.160700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:24.162628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 200/412] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:23 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:24.167977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:24.246696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045333-2f39-404e-8258-d4ef2c0c685f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:24.282535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:24.283427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.283708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.284006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] PATH_INFO: `/v3/projects/380a960ee385491dbc55afab2693ac72/groups/09bff0d0f0c549a6b36fc1ad9d176847/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.286311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] RBAC: Authorizing `identity:create_grant(project_id=380a960ee385491dbc55afab2693ac72, group_id=09bff0d0f0c549a6b36fc1ad9d176847, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:24.287807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:24.303406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 213/413] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jun 24 06:57:24 2022] PUT /identity/v3/projects/380a960ee385491dbc55afab2693ac72/groups/09bff0d0f0c549a6b36fc1ad9d176847/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 06:57:24.434266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:24.437387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9630f-d49c-4838-89da-6d738594ccf3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:24.486935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7225f-7248-43db-a691-a6be868efc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:24.487826 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7225f-7248-43db-a691-a6be868efc39 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.488124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7225f-7248-43db-a691-a6be868efc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.488391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7225f-7248-43db-a691-a6be868efc39 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.489673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7225f-7248-43db-a691-a6be868efc39 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:24.491111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7225f-7248-43db-a691-a6be868efc39 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:24.493249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 201/414] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:24 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:24.498964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:24.524850 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:24.604797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98af14-4746-4f86-80dd-d1ae174e0cbd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:24.639540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33df44-341b-442e-92a3-5a87437ed5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:24.640469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33df44-341b-442e-92a3-5a87437ed5ca None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.640746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33df44-341b-442e-92a3-5a87437ed5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.641021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33df44-341b-442e-92a3-5a87437ed5ca None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755/groups/1fe699112537457798d3281382199740/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.643202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33df44-341b-442e-92a3-5a87437ed5ca None admin] RBAC: Authorizing `identity:create_grant(project_id=ae9932c8860f4ad881a95e4095cda755, group_id=1fe699112537457798d3281382199740, role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:24.644674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33df44-341b-442e-92a3-5a87437ed5ca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:24.661627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 214/415] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jun 24 06:57:24 2022] PUT /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755/groups/1fe699112537457798d3281382199740/roles/90387e9afaca4d41b37d78e341b4e561 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:24.865713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e40f5-634b-42c2-afbd-f25ee07ebd0f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.865894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e40f5-634b-42c2-afbd-f25ee07ebd0f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.866174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e40f5-634b-42c2-afbd-f25ee07ebd0f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.867601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 202/416] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:24.874314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:24.874604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:24.874882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:24.892915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:24.894104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:24.967063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 215/417] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:24.990316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e40f5-634b-42c2-afbd-f25ee07ebd0f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.098213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e40f5-634b-42c2-afbd-f25ee07ebd0f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.136950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f1ffd-f2c3-4396-a577-8368d18b9edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:25.138275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f1ffd-f2c3-4396-a577-8368d18b9edf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.138749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f1ffd-f2c3-4396-a577-8368d18b9edf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.139228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f1ffd-f2c3-4396-a577-8368d18b9edf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.150326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f1ffd-f2c3-4396-a577-8368d18b9edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9b8f1ffd-f2c3-4396-a577-8368d18b9edf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:25.158622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:25.159542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:25.160365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:25.163091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 203/418] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:25.169109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.192058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.291860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe263a6-649b-42a5-bd25-c91b1761d447 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.317749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9627-b6d9-4e6d-8c96-f9dbcf8dafe4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.318078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9627-b6d9-4e6d-8c96-f9dbcf8dafe4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.318311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9627-b6d9-4e6d-8c96-f9dbcf8dafe4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.320025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 204/419] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:25.325030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.325310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.325585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.331040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:25.332056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.333400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.333681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.334445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:25.334754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:25.336230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:25.343610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:25.344909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:25.346384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 216/420] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:25.351651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.371938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.419506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 205/421] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:25.444083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.484219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.496300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34b20-055f-4569-8a24-6e3b11779abd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.547420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ee5d2-4783-4e7c-b675-d03bf3b3a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:25.548076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1479f-38bd-475e-bd06-6ac6ce5537b9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.548156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee5d2-4783-4e7c-b675-d03bf3b3a5be None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.548406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee5d2-4783-4e7c-b675-d03bf3b3a5be None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.548642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee5d2-4783-4e7c-b675-d03bf3b3a5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.582869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f840d95-6b9d-4fee-a760-c197726c7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:25.583738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840d95-6b9d-4fee-a760-c197726c7590 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.584049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840d95-6b9d-4fee-a760-c197726c7590 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.584323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840d95-6b9d-4fee-a760-c197726c7590 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.595072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f840d95-6b9d-4fee-a760-c197726c7590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8f840d95-6b9d-4fee-a760-c197726c7590 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:25.603876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:25.604746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:25.605543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 206/422] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:25.606725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c6d1-a785-4cf5-8e5a-6d35a23acde2 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.607012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c6d1-a785-4cf5-8e5a-6d35a23acde2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.607287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c6d1-a785-4cf5-8e5a-6d35a23acde2 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.613516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 207/423] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:25.614260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4c6d1-a785-4cf5-8e5a-6d35a23acde2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.616454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee5d2-4783-4e7c-b675-d03bf3b3a5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:25.617974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee5d2-4783-4e7c-b675-d03bf3b3a5be None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:25.636503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.700351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.722176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 217/424] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:25.723831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.724312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.724758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.735373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4c6d1-a785-4cf5-8e5a-6d35a23acde2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.745395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:25.746863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:25.778387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:25.779067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.779756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.780075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.781108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:25.781423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:25.783113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:25.795923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 208/425] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:25.797011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.831276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 218/426] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:25.832387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:25.898320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.924323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd289-a7eb-413c-90f4-13e4172fa790 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.958729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840580e3-d438-4b66-b2b5-cadef65de5fc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:25.959414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:25.960342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:25.960651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:25.960920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:25.962108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:25.962562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:25.963971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:25.966154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 209/427] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:25.967202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.005182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.005836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.006116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.006437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.076792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93496b5d-373c-4d4a-9a6c-f7159e85798b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.085350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.087580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.114340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.115144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.115420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.115689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.127928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:26.136221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:26.137298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 06:57:26.138269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:26.142414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 210/428] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:26.143387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.155828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.210014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 219/429] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:26.211184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.215296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.261291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dcf5f-fce3-44ee-ba34-1e4390aaf70c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.304512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.305901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.306678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.307252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.308856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.310766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.313269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 211/430] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:26.314196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.329532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e3f80-dc02-4f40-a589-a6690ee077e2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.365286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.366045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.366391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.366759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.367580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:26.372770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.374319 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.388641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 220/431] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:26.389721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.408999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.434415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f786a-5fa6-48b5-955d-69f99aa7d825 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.457323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.472315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.474043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.474528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.474992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] PATH_INFO: `/v3/projects/747035f4f8d34d9b99f97b83ce23e619` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.476700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] RBAC: Authorizing `identity:get_project(project_id=747035f4f8d34d9b99f97b83ce23e619)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.478719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.481200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 212/432] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/projects/747035f4f8d34d9b99f97b83ce23e619 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:26.482206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.495434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6b08a-0da6-442e-874d-3a9538b613c8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.529043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.529701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.529979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.530250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.531073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=747035f4f8d34d9b99f97b83ce23e619) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:26.531380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.532845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.539197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 221/433] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:26.539870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.596599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ce53f-aeea-42e9-9664-b6d21fc1d56a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.635123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf561597-de50-43c3-99c1-a068ae52a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.636472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561597-de50-43c3-99c1-a068ae52a209 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.636948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561597-de50-43c3-99c1-a068ae52a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.637539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561597-de50-43c3-99c1-a068ae52a209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.655405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.715247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8f3b-0529-4ea4-bf5e-3e286204b0e8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.718411 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf561597-de50-43c3-99c1-a068ae52a209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.720237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf561597-de50-43c3-99c1-a068ae52a209 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.758195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.764471 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f884-b444-4624-b1f0-f0bf85185c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.765765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f884-b444-4624-b1f0-f0bf85185c7b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.766399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f884-b444-4624-b1f0-f0bf85185c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.766773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f884-b444-4624-b1f0-f0bf85185c7b None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.768154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93f884-b444-4624-b1f0-f0bf85185c7b None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.769727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93f884-b444-4624-b1f0-f0bf85185c7b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.776663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 222/434] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:26.778327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b692a-394b-49c0-b931-ae4ef4fe1353 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.778743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b692a-394b-49c0-b931-ae4ef4fe1353 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.779118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b692a-394b-49c0-b931-ae4ef4fe1353 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.780927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 223/435] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:26.781704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b692a-394b-49c0-b931-ae4ef4fe1353 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.847311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 213/436] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:26.847311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.847311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.847311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.871004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:26.872224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:26.907109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b692a-394b-49c0-b931-ae4ef4fe1353 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:26.928380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:26.945837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:26.946495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:26.946775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:26.947043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:26.947979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=747035f4f8d34d9b99f97b83ce23e619) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:26.948218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:26.949939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:26.957087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 224/438] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=747035f4f8d34d9b99f97b83ce23e619&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:26.957421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:26.959928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 214/438] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:26.984969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.033056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.073167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4634d-6df5-4f01-8f3d-c214fc74f62e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.106698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48090-5ad4-4402-a878-00094ef5ac3b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.117856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffc5b6-6c8f-46b2-bec7-6e68dc517783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.118912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc5b6-6c8f-46b2-bec7-6e68dc517783 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.119279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc5b6-6c8f-46b2-bec7-6e68dc517783 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.119608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc5b6-6c8f-46b2-bec7-6e68dc517783 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.121024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffc5b6-6c8f-46b2-bec7-6e68dc517783 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.122736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffc5b6-6c8f-46b2-bec7-6e68dc517783 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.125240 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 225/439] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:27.126626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e6f8b-0c0d-436a-9d64-82fb34f33e16 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.126918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e6f8b-0c0d-436a-9d64-82fb34f33e16 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.127188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e6f8b-0c0d-436a-9d64-82fb34f33e16 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.128803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 226/440] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:27.133526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e6f8b-0c0d-436a-9d64-82fb34f33e16 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.157760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307178e-0d2a-4392-9299-855ab433b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.158568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307178e-0d2a-4392-9299-855ab433b16a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.158848 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307178e-0d2a-4392-9299-855ab433b16a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.159117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307178e-0d2a-4392-9299-855ab433b16a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.173793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307178e-0d2a-4392-9299-855ab433b16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4307178e-0d2a-4392-9299-855ab433b16a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:27.181651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:27.182547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:27.183813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 215/441] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:27.184731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.184731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.185059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.202491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:27.203669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:27.235043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.253615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e6f8b-0c0d-436a-9d64-82fb34f33e16 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.285412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 216/442] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:27.286181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.291898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.299604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.300758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.301038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.301463 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.302998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.306895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.306895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 227/443] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:27.312112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.401154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc8835-e2bf-4511-ac50-ac9c6a03ef25 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.419769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b4aa4-7de4-4ffe-884a-e89db87ded99 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.433655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.434319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.434594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.434862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.435609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:27.435995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.437377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.445215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 217/444] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:27.445981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.452761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.453571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.453848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.454117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.464750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:27.472839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:27.473789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:27.474563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 228/445] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:27.475201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.477053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.535633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.552488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c28de-5c4f-4eef-b228-72046b1ef850 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.578429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997e22-b326-4cc3-a7f7-9d2b5a1baf9a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.585877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.586519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.586797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.587068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.587913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=658e15b437f34e58aaffdfdd2f52944e, scope.project.id=ae9932c8860f4ad881a95e4095cda755) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:27.588220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.589656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.595484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 218/446] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=658e15b437f34e58aaffdfdd2f52944e => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:27.596261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.613523 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.614200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.614481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.614754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.694116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.695679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.715924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.728795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffb372-3ed9-4bf8-9b0b-447677f765ed None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.765110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.771239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.772043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.772295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.772567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.773354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:27.773661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.775033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.784290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 219/447] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:27.790245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.817259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 229/448] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:27.822812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:27.915356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101fe9a-86c3-4004-8396-70bcb5468490 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.948613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc1a36-ecc8-4580-8b1e-bcf6811a6864 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:27.953588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.954478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.954905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.955176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.977157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:27.984862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:27.985739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:27.986017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:27.986291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] PATH_INFO: `/v3/projects/380a960ee385491dbc55afab2693ac72` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:27.987468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] RBAC: Authorizing `identity:get_project(project_id=380a960ee385491dbc55afab2693ac72)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:27.989006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:27.990743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 230/449] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/projects/380a960ee385491dbc55afab2693ac72 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:27.996254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:28.022608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:28.027061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:28.028770 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:28.101455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e95c7-2ccc-424b-8e7b-ce989c8e90c9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:28.132209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 220/450] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:28.135536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:28.136561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:28.136848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:28.137187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] PATH_INFO: `/v3/groups/09bff0d0f0c549a6b36fc1ad9d176847` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:28.137995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:28.138374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] RBAC: Authorizing `identity:get_group(group_id=09bff0d0f0c549a6b36fc1ad9d176847)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:28.139820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:28.141464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 231/451] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:27 2022] GET /identity/v3/groups/09bff0d0f0c549a6b36fc1ad9d176847 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:28.147156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:28.189997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:28.239789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a947-ab63-4a69-b3cb-9fd207680fa2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:28.241124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:28.248969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbc24e-cee6-458a-9e04-3213d4c02303 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:28.276101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:28.276954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:28.277227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:28.277492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] PATH_INFO: `/v3/projects/ae9932c8860f4ad881a95e4095cda755` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:28.278683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] RBAC: Authorizing `identity:get_project(project_id=ae9932c8860f4ad881a95e4095cda755)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:28.280144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:28.281834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 221/452] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:57:28 2022] GET /identity/v3/projects/ae9932c8860f4ad881a95e4095cda755 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:28.283373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:28.284139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:28.284422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:28.284695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:28.285532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] RBAC: Adding query filter params (group.id=09bff0d0f0c549a6b36fc1ad9d176847, role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=380a960ee385491dbc55afab2693ac72) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:28.285843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:28.287210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:28.287364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:28.293542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 232/453] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:28 2022] GET /identity/v3/role_assignments?group.id=09bff0d0f0c549a6b36fc1ad9d176847&scope.project.id=380a960ee385491dbc55afab2693ac72&role.id=c55009d9dd08464ebde7f96db3459dea => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:28.396797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19099ea9-9880-4831-87b0-62ac8d30fad1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:28.419674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:28.435716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dfce1-95fc-4bd1-8ecc-2024c96c329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:28.436847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfce1-95fc-4bd1-8ecc-2024c96c329a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:28.437125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfce1-95fc-4bd1-8ecc-2024c96c329a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:28.437395 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfce1-95fc-4bd1-8ecc-2024c96c329a None admin] PATH_INFO: `/v3/groups/1fe699112537457798d3281382199740` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:28.438616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dfce1-95fc-4bd1-8ecc-2024c96c329a None admin] RBAC: Authorizing `identity:get_group(group_id=1fe699112537457798d3281382199740)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:28.440078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dfce1-95fc-4bd1-8ecc-2024c96c329a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:28.441715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 222/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jun 24 06:57:28 2022] GET /identity/v3/groups/1fe699112537457798d3281382199740 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:28.447829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:28.546283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f647a-bcae-40e7-8396-7196074a556f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:28.581431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:28.582080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:28.582364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:28.582638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:28.583484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] RBAC: Adding query filter params (group.id=1fe699112537457798d3281382199740, role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=ae9932c8860f4ad881a95e4095cda755) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:28.583802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:28.585280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4175d-8157-4678-8e10-b5d1ad10b50b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:28.591267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 233/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jun 24 06:57:28 2022] GET /identity/v3/role_assignments?group.id=1fe699112537457798d3281382199740&scope.project.id=ae9932c8860f4ad881a95e4095cda755&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:31.123256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca511-863a-4a2c-8882-3861aa5c791d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.123803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca511-863a-4a2c-8882-3861aa5c791d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.123904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca511-863a-4a2c-8882-3861aa5c791d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.125586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 223/456] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:31.131919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d357b-ca8f-4c9c-8159-2f71b5c3732d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.132850 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d357b-ca8f-4c9c-8159-2f71b5c3732d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.133333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d357b-ca8f-4c9c-8159-2f71b5c3732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.160808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c35d357b-ca8f-4c9c-8159-2f71b5c3732d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:31.162298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c35d357b-ca8f-4c9c-8159-2f71b5c3732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:31.183436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:31.253460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 234/457] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:31.293377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca511-863a-4a2c-8882-3861aa5c791d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:31.374709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7242a-d94b-4977-9d24-e65526d2e6ab None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.375222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7242a-d94b-4977-9d24-e65526d2e6ab None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.375696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7242a-d94b-4977-9d24-e65526d2e6ab None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.381358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 235/458] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:31.388354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.388906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.389370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.421892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca511-863a-4a2c-8882-3861aa5c791d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:31.425500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:31.426900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:31.488125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:31.488930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.489207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.489480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.513920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:31.515457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:31.552245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:31.553154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:31.553992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:31.553992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:31.553992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:31.553992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:31.554663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 236/459] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:31.556365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 224/460] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:31.561840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:31.579141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:31.657072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:31.681206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925737c-1681-450f-9cad-ec766f50eaf9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:31.688189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:31.721482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:31.722314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.722934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.722934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.723819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:31.724289 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:31.725815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0eb55-1a0e-462d-8d48-3715ef712b61 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:31.739255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 237/461] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:31.740878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2a43-b317-4980-aa9c-43e1246a1aa5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.741271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2a43-b317-4980-aa9c-43e1246a1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.741794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2a43-b317-4980-aa9c-43e1246a1aa5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.743285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 238/462] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:31.744746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd7075-c67a-47d1-84d6-7613d47bb632 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:31.748535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.748827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.749106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.766538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:31.767720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:31.784781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:31.785784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.786205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.786613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.799818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:31.801530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:31.821014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:31.821885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:31.822730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:31.822730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:31.822730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:31.822730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:31.825030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 225/463] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:31.826041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:31.843953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 239/464] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:31.845043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:31.921538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:31.931373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eba24-803e-4199-a16f-6813f356d34f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:31.934922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:31.966041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d8eb-8d20-42ea-9e90-9508de781477 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:31.967351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:31.968122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:31.968486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:31.968763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:31.969492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:31.970925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:31.993507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 226/465] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:31 2022] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:32.001200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.003573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.004311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.004585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.004868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.005613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:32.005924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.007358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de37a3-bae4-4da5-a05a-500088457704 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.026701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 240/466] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:32.028770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd8f6d-3648-4cb2-a348-3110cc13138b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.029077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd8f6d-3648-4cb2-a348-3110cc13138b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.029360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd8f6d-3648-4cb2-a348-3110cc13138b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.031291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 241/467] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:32.032028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd8f6d-3648-4cb2-a348-3110cc13138b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.157408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebe93f-e198-4de0-b6e3-7e4a2741d93e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.186632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd8f6d-3648-4cb2-a348-3110cc13138b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.204998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.205998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.206104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.206335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.218743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.220436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.223474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:32.230313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.230902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:32.231162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.231456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.232074 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.232584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.238577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-22f5de14-b6f3-4aa5-be68-1146eb55ab35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:32.241908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:32.242911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:32.243922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:32.243922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:32.243922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:32.243922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:32.244142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 227/468] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:32.245248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.245576 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.245820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.264372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 242/469] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:32 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:32.265544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.269893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:32.271336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:32.402187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 228/470] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:32.426968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.474412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6952e-21f2-4bf4-bf7a-63b7550f0063 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.516793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.517594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.518028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.518307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.519823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:32.520177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.521582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7632c1-e4fa-401b-a994-9272d933943f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.535728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 243/471] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:32.537075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380c0eb-28b5-4b09-b4a2-b6c20315ab79 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.537521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380c0eb-28b5-4b09-b4a2-b6c20315ab79 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.537791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380c0eb-28b5-4b09-b4a2-b6c20315ab79 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.543274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 244/472] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:32.544143 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380c0eb-28b5-4b09-b4a2-b6c20315ab79 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.554175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59aea9-0860-42a4-9f8b-58809555d14e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.585694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:32.592100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.592926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.593196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.593472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.604587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.606046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.611777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0ad16401-3619-42a4-90af-be5ae5f4f538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:32.625250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:32.626140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:32.626965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:32.626965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:32.626965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:32.626965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:32.626965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 229/473] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:32.627829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.631451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.631451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.649878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:32.651745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:32.683535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380c0eb-28b5-4b09-b4a2-b6c20315ab79 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.726095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 230/474] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:32.726261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.726865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.726967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.727167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.727413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.732567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.734089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.766292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 245/475] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:32 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:32.767132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.868137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8efde-3e5e-49ed-9e1d-bd8eb1e02170 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.883935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:32.888660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec1b87-8784-4447-8160-61b03a2bb720 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:32.892295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:32.942834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.943519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.943794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.944089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.944950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:32.945254 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.946669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.952241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:32.952934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:32.953213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:32.953486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:32.954311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:32.955724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:32.975317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.sql.core [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 06:57:32.975317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 06:57:32.975317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [parameters: {'id': '698fb83af82f4287b74069bc4d1984a8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 06:57:32.975317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80366) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 06:57:32.987700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 231/476] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:32.996059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jun 24 06:57:32.997725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 06:57:32.998713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application yield resource Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise self.value Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application session.commit() Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 06:57:32.999810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.flush() Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application compat.raise_( Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 06:57:33.000944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 06:57:33.001983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 06:57:33.002956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [parameters: {'id': '698fb83af82f4287b74069bc4d1984a8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:33.009455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 06:57:33.011121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:33.012790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 246/477] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jun 24 06:57:32 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:33.012790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:33.121679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04550ad2-a515-4120-b7bb-fecf3b4ae009 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:33.144641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e757-e7e6-4889-a702-a79265071880 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:33.162093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:33.162926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:33.163205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:33.163546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:33.175140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:33.185197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:33.187710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:33.189495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 247/478] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:33.192807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:33.193782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084d72-c9f1-45fe-aa03-544edd8a4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:33.194402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084d72-c9f1-45fe-aa03-544edd8a4594 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:33.194800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084d72-c9f1-45fe-aa03-544edd8a4594 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:33.195074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084d72-c9f1-45fe-aa03-544edd8a4594 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:33.195789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084d72-c9f1-45fe-aa03-544edd8a4594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:33.197668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084d72-c9f1-45fe-aa03-544edd8a4594 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:33.222967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 232/479] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:32 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:57:33.241286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:33.329830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168a77-c46a-43e8-8278-70c2bca37d5c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:33.377488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:33.378418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:33.378898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:33.379391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:33.380392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:33.380913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:33.382587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2201a-3b56-4b0f-94aa-3921076d2756 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:33.396753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 248/480] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:34.481793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ccfc-acea-4dfd-8731-4aa3d2a49fca None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:34.482785 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ccfc-acea-4dfd-8731-4aa3d2a49fca None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:34.483265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ccfc-acea-4dfd-8731-4aa3d2a49fca None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:34.485141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 233/481] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:34.490780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db60e-30d9-4d2a-b99b-12c8fba5e660 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:34.492550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db60e-30d9-4d2a-b99b-12c8fba5e660 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:34.493032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db60e-30d9-4d2a-b99b-12c8fba5e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:34.515330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bf9db60e-30d9-4d2a-b99b-12c8fba5e660 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:34.516888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bf9db60e-30d9-4d2a-b99b-12c8fba5e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:34.611818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f698c86-cdc5-4a4f-852e-aa57b427511a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:34.612489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f698c86-cdc5-4a4f-852e-aa57b427511a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:34.612963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f698c86-cdc5-4a4f-852e-aa57b427511a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:34.613243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 249/482] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:34.614748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 234/483] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:34.619838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:34.620151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:34.620431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:34.636697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:34.637784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:34.652090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:34.665264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f698c86-cdc5-4a4f-852e-aa57b427511a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:34.705152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 250/484] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:34.728071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:34.744901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:34.826759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57578d-fdcd-400b-b044-2878ef1e0869 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:34.853699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f698c86-cdc5-4a4f-852e-aa57b427511a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:34.863029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:34.864272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:34.864864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:34.865356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:34.877407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:34.886184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:34.891075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:34.892293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:34.893750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:34.893750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:34.893750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:34.893750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:34.895869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 251/485] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:34.901817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:34.902070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:34.909827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:34.910714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:34.911515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 235/486] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:34.924200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:34.929534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.060226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.066410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aef540-b02b-4ed1-ab82-9469c90c0994 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.073806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c9735-69fa-4b52-b40c-3278050c7fab None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.134023 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.134696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.134979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.137117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.137906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:35.138218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.139607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.142441 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.143066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.143346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.143616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.144398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:35.144706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.146091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.159401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 252/487] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:35.166853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.167694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 236/488] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:35.170683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.311591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.328777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57af611-4eb2-4f75-a840-834587a42948 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.345298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3662-5240-43eb-b605-79d99f61b394 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.362620 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.363479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.363753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.364075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.375190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.376692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.381944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.383116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.383599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.384097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:35.395479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:35.396349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:35.397183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:35.397183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:35.397183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:35.397183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:35.397183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 237/489] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:35.397992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.399705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.403710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.408160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:35.420560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:35.421574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:35.422381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:35.422381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:35.422381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:35.422381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:35.424624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 253/490] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:35.430989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.513538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b130c7-106a-42fc-a336-088afcc0a4ab None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.531591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd974d7-302d-4f3c-8c17-07c80e1f8d70 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.548745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.549739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.550193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.550643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.551539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:35.552054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.553602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.566267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.567021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.567517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.568057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.568997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:35.569493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.571109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.571552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 238/491] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:35.572841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.580200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.586035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 254/492] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:35.591499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.636284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.674945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60970d9-e013-4375-8df7-15f2e91fd701 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.699980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab167b-850c-46e2-80d7-0a841394bf3f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.709895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.711102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.711588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.712101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.720069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.721832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:35.742252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:35.743198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:35.744132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:35.754275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 239/493] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:35.757669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.775022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.776786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.777269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.777736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] PATH_INFO: `/v3/users/glance` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.787744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.790052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3127045d-f80b-4de8-a57e-b8f2fccbf3db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:35.811266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:35.812276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 06:57:35.813407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:35.816608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 255/494] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:35.818467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f0b7-56f0-4a0f-9f41-31cf3475c83f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.818953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f0b7-56f0-4a0f-9f41-31cf3475c83f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.819780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f0b7-56f0-4a0f-9f41-31cf3475c83f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.823473 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 256/495] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:35.824453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f0b7-56f0-4a0f-9f41-31cf3475c83f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:35.878845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.903488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e680b95-00d3-4a1b-92a9-0463e2984e4d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.939375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:35.945224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f0b7-56f0-4a0f-9f41-31cf3475c83f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:35.956882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.957639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.958001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.958343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.959251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:35.959620 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.961260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba251b-cb28-4366-92f3-841e4af41a47 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.986130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:35.986802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:35.987080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:35.987369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:35.988246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:35.988554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:35.990002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6992e8-b35d-4703-86c5-66cc94e559bc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:35.998666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 240/496] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:35.999957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.000242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.000512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.016058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:36.017234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:36.026712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 257/497] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jun 24 06:57:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:36.028195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55abe-46b2-47af-9756-f4a1a61a216c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.028460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55abe-46b2-47af-9756-f4a1a61a216c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.028738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55abe-46b2-47af-9756-f4a1a61a216c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.030166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 258/498] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:36.031318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d423-1053-460a-9bb9-b72ebe8b48a7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.031495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d423-1053-460a-9bb9-b72ebe8b48a7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.031773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d423-1053-460a-9bb9-b72ebe8b48a7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.035158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 259/499] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:36.035158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448d423-1053-460a-9bb9-b72ebe8b48a7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.087397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 241/500] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:36.088281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.138709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448d423-1053-460a-9bb9-b72ebe8b48a7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.140271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.173699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45bc01-80a8-4b50-84af-e1de708b6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.174340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45bc01-80a8-4b50-84af-e1de708b6f8a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.174618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45bc01-80a8-4b50-84af-e1de708b6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.174889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45bc01-80a8-4b50-84af-e1de708b6f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.197246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df51d6e-0985-42cc-9939-9396f528f6fc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.207554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.233250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbf886-1172-40b1-add6-09d0e66b9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.234169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbf886-1172-40b1-add6-09d0e66b9093 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.234720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbf886-1172-40b1-add6-09d0e66b9093 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.235196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbf886-1172-40b1-add6-09d0e66b9093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.245013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45bc01-80a8-4b50-84af-e1de708b6f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:36.246491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45bc01-80a8-4b50-84af-e1de708b6f8a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:36.307686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbf886-1172-40b1-add6-09d0e66b9093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:36.309181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbf886-1172-40b1-add6-09d0e66b9093 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:36.349360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 260/501] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:36.350646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.350983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.351258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.357722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.369825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:36.370999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:36.410986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 242/502] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:36.412298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.412604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.412854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.428317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:36.429602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:36.432331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.442489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 261/503] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:36.443329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.498722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 243/504] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:36.499472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.552788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad10a1-10b0-45cd-822d-0a42f24b3fc5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.581376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.587491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.588338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.588622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.588894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.596391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67a92-419c-47cb-944a-d75136102dfd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.599760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:36.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:36.608788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:36.609550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 262/505] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:36.610186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.635121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.636039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.636339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.636598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.644633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.647446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:36.649342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:36.667073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:36.667957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:36.668862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:36.668862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:36.668862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:36.668862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:36.668862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 244/506] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:36.669325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.712849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a71151-9bfd-4080-bde3-87cf22dfe612 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.747026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.747825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.748120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.748389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.758986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:36.760447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:36.765644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e27a6-b9b6-4b18-b74f-a66e9526b02d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:36.777355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:36.778225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:36.779041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:36.779041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:36.779041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:36.779041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:36.779041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 263/507] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:36.779304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.801315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.802116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.802399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.802676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.813416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:36.814890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:36.825545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:36.831864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:36.832864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:36.833899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:36.833899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:36.833899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:36.833899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:36.833899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 245/508] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:36.833899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.881559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:36.882912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2f801-fa9a-4246-abd2-c8eaff659442 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.915251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.916078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.916365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.916641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.926508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:36.934346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:36.935182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:36.936026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:36.936607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95762-5efd-47a8-8a4c-59da07751549 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:36.936677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 264/509] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:36.936677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:36.973866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:36.974527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:36.974807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:36.975080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:36.975938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:36.976252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:36.977954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:36.985681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 246/510] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:36.986458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.039764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c9a29-563b-40a6-99c2-991bf1afcb87 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.042551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.073730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.074388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.074693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.074955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.075677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.076021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.077392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.083552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f993e0b-1703-4c05-8cc9-b483d1de87d4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.089837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 265/511] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.090328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.090627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.121371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.122063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.122336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.122644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.123508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.123822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.125410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.137383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 247/512] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.138182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.191094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ad4e-0c8e-484d-ac13-e593c32799b5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.226335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.227005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.227283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.227934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.228659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.228967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.230343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.241653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 266/513] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.242043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea21ea-8e4a-46ab-b32c-c5f2fbea2890 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.242436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.272870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.282464 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.283139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.283417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.283688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.284478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.284767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.286148 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.294153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 248/514] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.294869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.324025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.356172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0cde-f77e-40bd-9712-ed425ff06a3b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.394553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.395360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.395646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.395955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.397775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a02e-84bb-45e7-b37b-c182c0ffa45d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.406309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.407774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:37.424759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:37.425766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:37.426800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:37.426800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:37.426800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:37.426800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:37.426800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 267/515] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:37.427089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.433896 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.434696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.434974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.435624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.443457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.445033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:37.459984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:37.460935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:37.461769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 249/516] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:37.462469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.505425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.528415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923f422-5df2-4f3c-83d8-c02a6523dba7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.553562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.561031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.561711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.562002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.562280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.566203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373d661-a3c7-49ea-8c06-014f22cfc38d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.569073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.570624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:37.585507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:37.586509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:37.587324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 268/517] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:37.589179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.598757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.599425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.599700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.600000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.600702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.602235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.624203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 250/518] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:37 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:37.625003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.713137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be5184-54ee-4067-9d6b-f9520857329d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.741603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a593-9652-4303-97b3-db8decd33ffa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.753994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.754821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.755106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.755383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.759138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.769174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.770691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.781084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.781751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.782038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.782583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.783198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.783504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.784916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:37.790645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:37.791454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:37.792399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:37.792399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:37.792399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:37.792399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:37.792399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 269/519] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:37.793185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.802224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 251/520] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.803350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.808080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:37.905509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a857-bb30-4a81-83a0-ae1605fca642 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.917248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1963-b56e-4722-a3dc-903a08b473d9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:37.942990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.944081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.944363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.944665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.945458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.945764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.947455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.951618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:37.952318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:37.952604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:37.952880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:37.953677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:37.953988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:37.955423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:37.967131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 270/521] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.968204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:37.979669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 252/522] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:37.980556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.023498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.046278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.079281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da088152-3d0b-4ce2-b5d2-6891b1459680 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.085574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c7731-a142-4dec-bdc6-51df4aace8d2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.114676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.115336 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.115622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.115916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.116702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:38.117016 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.119900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.126138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.126946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.127224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.127493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.135325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 271/523] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:38.135325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.135564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:38.151302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:38.152449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 253/524] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:38.153447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.239195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c370e1-6771-4632-90bf-953f144ad9ea None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.247994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.260963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a9acb-18e9-4b7a-aa31-755f217eb53c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.273545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.274260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.274545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.274840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.275664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f8f4b69c63f444d1997b3426cdf1eb00) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:38.276010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.277455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.283013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 272/525] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/role_assignments?user.id=f8f4b69c63f444d1997b3426cdf1eb00&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:38.283796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.298416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.311895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.313123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.313520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.313799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.314831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=d928c6bee9f744c082c98811fcb35629) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:38.315142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.319099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.327610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 254/526] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/role_assignments?user.id=d928c6bee9f744c082c98811fcb35629&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:38.328579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.453209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2a37-45d8-4bd9-818d-babf1a442fca None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.513717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.513930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.514202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.514477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.522131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a670dc-45a0-4c1f-9a2a-8405211c6648 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.524226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.525841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:38.542277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:38.543247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:38.544155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 273/527] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:38.549344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.572705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.573766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.574248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.574734 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.576372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:38.576967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.579061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.589744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.609658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 255/528] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:38.616907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.679703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.707654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151630cc-80c5-4ea0-aadf-17a430d3c937 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.744122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.744807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.745087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.745363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.746221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:38.746536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:38.748080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:38.768505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 274/529] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:38.773964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:38.775776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6348d-bdb7-4b6a-aaeb-9891f9941189 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.879930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:38.885157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.885946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.886325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.886697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:38.891176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7fc74-9f5a-47e5-b419-fa8dc6435648 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:38.931598 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:38.932559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:38.932983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:38.933396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.009352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.011475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.108248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:39.118203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 275/530] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 06:57:39.119185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.126233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.126413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:39.202600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:39.304009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 256/531] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:39.307032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54507e9b-7383-4277-8373-233d8190d367 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:39.309713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:39.366454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:39.367635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.368177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.368671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.390073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.391887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:39.411261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:39.412186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:39.413031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:39.413031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:39.413031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:39.413031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:39.415404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 276/532] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:39.420270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:39.468272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:39.505333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ef408-b6b4-4f94-a1ac-b63b0fe2364a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:39.569342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:39.570202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.570484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.570760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.577073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1816-5dec-40ee-8e0a-e59876327a3c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:39.588860 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.590339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.601831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:39.623964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:39.625282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:39.626102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:39.626102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:39.626102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:39.626102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:39.626746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 257/533] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:39.632773 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:39.641370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:39.642091 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.642376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.642655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.648662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:39.648990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.650425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.671769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 277/534] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:39.677475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:39.747724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550ca6e-804f-44ce-839c-f61f6fae03b2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:39.783127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:39.783870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.784329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.784605 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.785383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:39.785694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.787082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.799546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 258/535] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:39.804630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:39.863503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60643b4-9cd7-4af5-86e6-43f1979fcac5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:39.865396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:39.885858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:39.928012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:39.928916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.929154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.929442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.933214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3334-8d47-4ae5-958d-b1a25926a57e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:39.936523 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.937648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8f661736-da33-4fde-84a4-701d9d0d3602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:39.951316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:39.952201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:39.953485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 278/536] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:39.954133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b5fc-67b8-40f2-88df-4f997244fa73 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.954284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b5fc-67b8-40f2-88df-4f997244fa73 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.954550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80b5fc-67b8-40f2-88df-4f997244fa73 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.955967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 279/537] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:39.961345 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.961628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.961904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.974711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:39.976010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:39.976496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:39.976984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:39.978927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:39.980145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:39.985247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:39.986925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:40.002199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:40.003003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:40.003956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:40.006381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 259/538] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:40.007463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.047352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 280/539] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:40.048250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.113454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799c6d-9770-4b11-b893-22cae380ed3e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.134029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:40.156929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:40.157461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.158357 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.158935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.159480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.160644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:40.161166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:40.163784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.167581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bfaa-e73d-4854-b488-62429a4f11e9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.177316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 260/540] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:40.178563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.209803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.210932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.211464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.211983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.213052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:40.213563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:40.215368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.229682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 281/541] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:40.231038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.303658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee0ba-9ca3-4cdd-9e76-69fa3ae3af58 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.339437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.340326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.340603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.340867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.342890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fd601-8059-4ce2-9e04-1c4e2c84c314 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.351378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:40.359582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:40.360484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:40.361677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 261/542] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:40.362535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.387990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.388981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.389485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.389992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.391284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=d6e8bab40c4b4f029d9ac7600d756797) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:40.391867 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:40.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 282/543] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/role_assignments?user.id=d6e8bab40c4b4f029d9ac7600d756797&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:40.401849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.402711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:40.426558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:40.543890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86dd7-cf55-442d-acbb-05180eb12e67 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.590576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d35101-053e-4675-ba05-edf3db3213d7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.596013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.596689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.596967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.597237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.599892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=4530cddbad6f4446beaf33a67135257e) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:40.599892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:40.601182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445b618-b0ef-402c-925a-9fef10b7c661 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.608315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 262/544] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/role_assignments?user.id=4530cddbad6f4446beaf33a67135257e&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:40.616000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e4f47-22d5-47af-ae67-71f544f749ba None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.616000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e4f47-22d5-47af-ae67-71f544f749ba None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.616000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e4f47-22d5-47af-ae67-71f544f749ba None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.616000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 263/545] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:40.616936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934c0f2-3e76-40ff-81a4-473bdf1b0b89 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.617222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934c0f2-3e76-40ff-81a4-473bdf1b0b89 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.617498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934c0f2-3e76-40ff-81a4-473bdf1b0b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.635099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c934c0f2-3e76-40ff-81a4-473bdf1b0b89 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:40.636346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c934c0f2-3e76-40ff-81a4-473bdf1b0b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:40.660300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.661026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.661360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.661628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.662433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:40.662740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:40.664235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.682270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 283/546] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:40.688838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.753790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 264/547] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:40.755227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757912d4-d390-4549-a584-a54c6942ba56 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.755521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757912d4-d390-4549-a584-a54c6942ba56 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.755800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757912d4-d390-4549-a584-a54c6942ba56 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.761470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 265/548] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:40.763274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.763639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.764024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.790173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:40.791360 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:40.822694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:40.823952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:40.848250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfb3c-70c2-4641-8a56-1db0c2ec190d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:40.879998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 266/549] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:40.880884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:40.897173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:40.898127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:40.898446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:40.898759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:40.910514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:40.912062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:40.930403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:40.931286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:40.932138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:40.932138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:40.932138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:40.932138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:40.935944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 284/550] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:40.936835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.000579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dfdfd-c9ee-416f-9778-47f62869b455 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.036599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.037444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.037726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.038003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.042047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4802-f8bb-4951-9acb-279fed906be5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.048986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:41.056914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:41.059392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 267/551] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:41.060796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.076867 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.084430 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.085638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.086084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.086494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.090562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.097591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:41.106189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:41.107071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:41.107917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:41.112211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 285/552] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:41.113348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.204163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ad0c-8d17-4162-9396-9ff2edad9a48 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.217756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0dae8-b510-4494-b8f7-96f339b990bb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.252981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.253654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.253934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.254205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.254951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:41.255252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.255819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.256665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.256987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.257480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.258224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.259575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:41.260184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.261761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.270616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 286/553] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:41.271997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.278571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 268/554] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:41.279768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.340656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.394563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.405250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bd7e9-b14c-4475-a9a3-9eb377847751 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.412660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcbb44-ee6b-47f2-bdbc-5e625c3ad331 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.442736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.443914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.444598 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.445114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.446034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:41.446571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.446911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.447772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.448157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.448494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.448997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.462419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.462419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.463146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 287/555] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:41.464172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:41.481260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:41.482234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:41.483082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:41.483082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:41.483082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:41.483082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:41.487634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 269/556] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:41.488557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.574803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257de156-e551-4c4f-9e7b-34c73cefc4e8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.589106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b65bdd-6ef2-4078-9ed1-fd3a11c2bc35 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.590103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.612692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.613781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.614321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.614795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.623412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.623728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.624556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.624838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.625113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.626437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.628171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.635765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.637407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:41.643561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:41.645193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:41.646118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:41.648835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 288/557] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:41.649824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:41.663618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:41.664532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:41.665403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:41.665403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:41.665403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:41.665403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:41.669587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 270/558] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:41.670405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.759624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f621e6e-6644-49f0-ad80-3cd3013f5151 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.770417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69483db-bac4-4173-adbf-691a2343ad84 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.795755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.796761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.797243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.797735 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.798657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:41.799181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.800856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.804342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.805015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.805292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.805562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.806396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:41.806704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.808157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.815798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 289/559] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:41.816961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.834803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 271/560] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:41.835939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:41.853533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.896331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:41.924224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b8ce-5d8a-441b-8543-38e2b6a1208b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.936482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eda3a-6aff-43d6-899e-2b75cfe812f5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:41.962992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.964561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.965049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.965675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.967182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:41.967692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.969352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.970773 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:41.971572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:41.971866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:41.972171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:41.979671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:41.981276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:41.985093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 290/561] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:41.986197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:42.001086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:42.002150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:42.003081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:42.006829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 272/562] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:42.007873 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.112938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f4a51-9dc0-437c-a13c-2c38976e7ce4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.116076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.125502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.135609 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a4ecb-087d-4547-b555-b65d519a3f77 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.164273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.165266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.165548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.165819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.175811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.176638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.177313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.177758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.178271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.178735 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:42.199460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:42.200488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 273/563] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:42.202051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.259897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.261957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.328674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0637e-9e9c-4bdb-8331-97945808c8e0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.363826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.372288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 291/564] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:42.373487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.375498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.376213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.376492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.376763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.377942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:42.378260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.380632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.399586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 274/565] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:42.400758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.425172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.502366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8afff-8b22-462b-9d27-e1b5a1f7c7e4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.516405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb6bd-586f-43b8-b358-f185e1e1860f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.540675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.541339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.541644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.541889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.542757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:42.543058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.544639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.555706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.556541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.556831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.557116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.567644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 292/566] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:42.567970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.568468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.569455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a3929ab6-7826-450c-8348-a9a12f14d374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:42.587439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:42.588385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:42.589233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:42.589233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:42.589233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:42.589233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:42.589233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 275/567] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:42.590185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa61eb-28cd-4ae4-9b6f-0aab7684025d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.590289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa61eb-28cd-4ae4-9b6f-0aab7684025d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.590486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa61eb-28cd-4ae4-9b6f-0aab7684025d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.595925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 276/568] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:42.595925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa61eb-28cd-4ae4-9b6f-0aab7684025d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.629281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.674847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.678652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e74f-7e8d-47c0-acf5-1a1575e8d039 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.700272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa61eb-28cd-4ae4-9b6f-0aab7684025d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.711905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.712698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.712977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.713248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.722998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.724499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.734347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.735145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.735425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.735730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-04af74e9-e92e-4ada-88a4-4df678e02ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:42.742693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:42.743708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:42.744659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:42.744659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:42.744659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:42.744659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:42.744659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 293/569] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:42.745023 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba716f-77fb-4b22-bcf7-c534bbb19802 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.745295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba716f-77fb-4b22-bcf7-c534bbb19802 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.745560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba716f-77fb-4b22-bcf7-c534bbb19802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.750558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.752058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.761425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5fba716f-77fb-4b22-bcf7-c534bbb19802 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:42.762592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5fba716f-77fb-4b22-bcf7-c534bbb19802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:42.770792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:42.771863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:42.772764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:42.772764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:42.772764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:42.772764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:42.772764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 277/570] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:42.773537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.829556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 294/571] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:42.831027 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498ef8-dc01-408f-852c-48ea254416b7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.831340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498ef8-dc01-408f-852c-48ea254416b7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.831571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498ef8-dc01-408f-852c-48ea254416b7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.832871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 295/572] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:42.833558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97498ef8-dc01-408f-852c-48ea254416b7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.874207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.883328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c039a6-259f-4bd2-a525-782c3c774012 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.907669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:42.916073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.916737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.917012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.917281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.917998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:42.918538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.919685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.931727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 278/573] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:42.932490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:42.946539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97498ef8-dc01-408f-852c-48ea254416b7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:42.981162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:42.981828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.982112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.982386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:42.983113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:42.983419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:42.984827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8fb9f-4d36-4dc7-abcc-bed64eca6a45 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:42.995806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 296/574] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:42.996994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:42.997286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:42.997566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.014132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:43.015315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:43.031213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a95a1c-c646-4ea0-b4f8-20c8bef486fb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.063076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.063735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.064041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.064314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.065030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:43.065334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.066689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.078315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 279/575] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:43.079099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.087935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 297/576] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:43.087935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.112233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.127427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.179972 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87682b0b-8feb-45ff-ae76-89675fefac38 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.186053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9acb96-8052-4c61-beab-672e1e744e18 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.213638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.214444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.214723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.214995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.218494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.219291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.219573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.219871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.225321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:43.226822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.228603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:43.233430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:43.234399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:43.235242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 280/577] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:43.236513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:43.242175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:43.243195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 298/578] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:43.244418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.327595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.336315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080172-111b-4996-b10a-4b66c4de4422 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.343366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.344180 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1424e-c2af-4acd-8255-3df297c8c75b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.370772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.371572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.371858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.372141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.376975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.377772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.378050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.378320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.378864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.380353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.385012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.386495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:43.394756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:43.395793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:43.396876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:43.400757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:43.401986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:43.402863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:43.403271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 281/579] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:43.403271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.403395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 299/580] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:43.403395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.500545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1df80-e750-4bf3-a4ae-b42a7e1c5be4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.500739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d7e7-0507-4205-b762-e03dceb80972 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.534508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.535164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.535449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.535720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.536493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:43.536796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.538315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.543145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.543962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.544243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.544514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.546712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 300/581] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:43.547299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.558022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:43.560054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:43.566560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:43.567572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:43.568471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 282/582] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:43.569146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.596286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.654362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b7447-23b4-45ea-9957-9ffd9abfc768 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.669545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd0616-a1ae-4bcb-bb68-61f07a8884ed None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.687779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.688470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.688744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.689014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.689803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:43.690106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.691519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.701870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.702521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.702802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.703075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.703300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 301/583] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:43.703869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:43.704100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.704184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.705663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.718771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 283/584] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:43.719567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.772728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.804280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.807630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa593c-5cd2-4c86-9f59-e7c30acc172a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.819703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0a11-ef46-4466-8f6e-a282d5e1c17c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.841790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.842452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.842733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.843010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.843805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:43.844143 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.845554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.855225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.856042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.856321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.856575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.857176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 302/585] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:43.857957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.866950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:43.868422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:43.886102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:43.887112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:43.888155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:43.888155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:43.888155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:43.888155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:43.888155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 284/586] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:43.888493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:43.963372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f33e-887a-44a1-bdfd-ba7546d9564d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.986541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d89dd-fc9b-4b75-87d7-02f0715b4a1d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:43.987796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:43.996699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:43.997365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:43.997644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:43.997911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:43.998647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:43.998945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.000345 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.008124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 303/587] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:44.008866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.021905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.022641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.022980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.023198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.024048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f528585e29824f548ba7b76848bd0f57) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:44.024385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.025803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.031536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 285/588] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:43 2022] GET /identity/v3/role_assignments?user.id=f528585e29824f548ba7b76848bd0f57&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:44.032144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.046913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:44.120925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007c659-82f2-4b3a-88d0-34034fdeff7e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.154827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661565-2ca2-4cb9-91fb-10dbe6328e4e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.157405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.158413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.158759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.159095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f8f4b69c63f444d1997b3426cdf1eb00/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.176147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=f8f4b69c63f444d1997b3426cdf1eb00, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.178044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.192687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 304/589] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:44 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f8f4b69c63f444d1997b3426cdf1eb00/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:44.193543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.195200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.196474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.196893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.198178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/d928c6bee9f744c082c98811fcb35629/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.230818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=d928c6bee9f744c082c98811fcb35629, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.232945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.242514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:44.255375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 286/590] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:44 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/d928c6bee9f744c082c98811fcb35629/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:44.256880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.324043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519f8bc-fd60-4e5f-b04c-66dde6720b46 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.340393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:44.371146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.371882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.372182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.372753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.373783 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:44.374090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.375646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.395724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 305/591] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:44.402376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.437444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1302-bcdc-44b8-a9b4-00f63bc27bd3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.482415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.483233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.483510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.483777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.496743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.498355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:44.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:44.520858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:44.521938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:44.521938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:44.521938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:44.521938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:44.521938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 287/592] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:44.527380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.541224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:44.546726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baba812-e925-4e21-8102-111a4ca4e3da None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.585009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.586163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.586595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.587004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.595224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.596941 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:44.612182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:44.613331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 06:57:44.614282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:44.616724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 306/593] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:44.628673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.660989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ab83-efc7-48e6-bd2e-a6a92699fa15 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.663567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:44.704089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.706139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.706430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.706704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.709161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:44.709482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.710950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.738055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 288/594] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:44.744359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.871171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4a24-54cf-4859-bc32-836b2d01061c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.878071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d976ea3-6e32-4d33-9a8a-d6c012ad3e8b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:44.915722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.916809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.917227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.917657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.925889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.927508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:44.942875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:44.944054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:57:44.945260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:44.947538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 289/595] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:44.954558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.955151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:44.959875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:44.959875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:44.959875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:44.959875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:44.959875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:44.959875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:44.978372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 307/596] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:44.988787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:44.996338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:45.035907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:45.138378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4a25-bd07-4b28-9224-fecbe3f82640 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.154493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4c08-7bb2-4d02-a660-b8fa40eb6ce8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.191347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.192219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.192501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.192775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.206319 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.207813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.221098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.221786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.222065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.222340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.223194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:45.223500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.224952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:45.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:45.230641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:45.231716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:45.231716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:45.231716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:45.231716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:45.231716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 308/597] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:45.238077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.263738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 290/598] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jun 24 06:57:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:45.270173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.361590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:45.402709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df907-8baf-44ec-a934-b44dc6ae1b39 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.414152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:45.444354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda52676-4669-48b2-a8fa-dd0010f0e331 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.468962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.469631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.469910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.470182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.470902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:45.471204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.472605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.491742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 309/599] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:45.497376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.512784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.513745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.514086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.514422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.534412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.536025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:45.568678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:45.569720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:45.570591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:45.570591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:45.570591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:45.570591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:45.573495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 291/600] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:45.582709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.645879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330127-045a-4d00-93f2-bc968eb8bcab None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.673448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:45.696580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.697790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.698277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.698751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.717166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.718713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933101-0664-4924-9704-e2b41ba0df89 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.719652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:45.748179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:45.749132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:45.750079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:45.756345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.756345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.756345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.756345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.756699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:45.756699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.757745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.758856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 310/601] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:45.763381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:45.765818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.775630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 292/602] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:45.779579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.878808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439e65-21c6-48b0-868d-971ba18f7f54 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.912071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.912881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.913259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.913530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.914224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd504c-ca7f-453c-b31a-81b2776e7529 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:45.920417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.921857 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:45.936495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:45.937390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:45.938270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 293/603] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:45.949196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:45.964299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:45.964870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:45.965153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:45.965428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:45.966229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:45.966538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:45.967994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:45.995349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 311/604] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:46.004778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:46.054592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:46.055266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:46.108729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b6f74-0dab-436c-9a0b-6d5241191ea3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:46.144061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:46.144958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.145236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.145508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/d6e8bab40c4b4f029d9ac7600d756797/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.160815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=d6e8bab40c4b4f029d9ac7600d756797, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:46.162281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:46.171088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deba41-5c0a-466b-abe1-33a1513366d8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:46.180033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 312/605] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:46 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/d6e8bab40c4b4f029d9ac7600d756797/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:46.214934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:46.215540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.215819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.216115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.216923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:46.217229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:46.218667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac6fb5-e7c0-4f61-82cb-150e2a72b933 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:46.235801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 294/606] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:46.238783 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:46.351504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:46.356131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95149-f660-4294-a197-44e863c9bd52 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:46.410057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:46.411022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.411353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.411628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/4530cddbad6f4446beaf33a67135257e/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.420104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf271-750c-4caf-91f8-bbcce1db7f37 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.420381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf271-750c-4caf-91f8-bbcce1db7f37 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.420665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf271-750c-4caf-91f8-bbcce1db7f37 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.422338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 295/607] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:46.427564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a2538-114e-467d-be98-9d1f8ac0ef67 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.427869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a2538-114e-467d-be98-9d1f8ac0ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.428158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a2538-114e-467d-be98-9d1f8ac0ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.444795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=4530cddbad6f4446beaf33a67135257e, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:46.446290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:46.455543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-267a2538-114e-467d-be98-9d1f8ac0ef67 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:46.456980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-267a2538-114e-467d-be98-9d1f8ac0ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:46.473352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 313/608] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:46 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/4530cddbad6f4446beaf33a67135257e/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:46.539656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 296/609] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:46.567756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:46.691793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08c5dd-1850-4ce0-bdd5-4eda2d4aa2cf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:46.738320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:46.739044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.739312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.739586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.747799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a86a6-47f1-4003-8841-11524f9d6e11 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.748329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a86a6-47f1-4003-8841-11524f9d6e11 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.748405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a86a6-47f1-4003-8841-11524f9d6e11 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.750009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 297/610] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:46.755486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903c4c-122f-4510-b37b-7a142ece7cdd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.756009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903c4c-122f-4510-b37b-7a142ece7cdd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.756363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903c4c-122f-4510-b37b-7a142ece7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.757226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:46.766493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:46.767393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:46.768257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:46.774663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 314/611] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:46.779206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:46.793780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c0903c4c-122f-4510-b37b-7a142ece7cdd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:46.794991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c0903c4c-122f-4510-b37b-7a142ece7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:46.800290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:46.863438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:46.898587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 298/612] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:46.900202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793ae6-322b-4028-bcd4-6903f1a2e585 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.900567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793ae6-322b-4028-bcd4-6903f1a2e585 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.900938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793ae6-322b-4028-bcd4-6903f1a2e585 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.902611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 299/613] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:46.908173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.908531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.908881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.926000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a6ca-ce48-40b9-873a-6f818c730568 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:46.927703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:46.929308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:46.967638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:46.968457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:46.968738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:46.969012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:46.969772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:46.970079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:46.971711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:46.981613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 315/614] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:46.982454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.011982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 300/615] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:47.012829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.075606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.113136 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a559168-be29-4a70-a68d-504b29aff0f2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.154720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.155536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.155822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.156108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6af05-dea2-4918-be64-c7a29bd3c4f9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.156230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.159211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.171330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:47.180139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:47.181066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:47.181895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:47.184307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 316/616] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:47.185009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.202858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.204056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.204570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.205202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.216579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.218350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:47.237827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:47.238777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:47.239664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:47.239664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:47.239664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:47.239664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:47.246365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 301/617] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:47.247447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.288740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20006f9-cb15-4a1d-a3ec-cbf687c603f7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.323741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.324587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.324867 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.325144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.328151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.337785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:47.352465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:47.353712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:47.354531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:47.357497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be87c1-0c4e-4cad-88e9-0382dfed3b68 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.358931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 317/618] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:47.360061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.400449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.401616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.402098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.402572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.403626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:47.404246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.405843 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.415279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 302/619] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:47.416323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.439154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.501613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b2eb-53d8-41be-9fe9-d850d87fe9d3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.527110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882aac4-5142-4872-b3f6-6103310661bc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.543452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.544191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.544472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.544746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.545480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:47.546033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.547816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.568218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.569188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.569726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.574430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.574570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 318/620] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:47.574570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.576219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:47.576777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.578375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.587805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 303/621] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:47.589017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.636429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.684545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.705666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ebd4-72e5-4205-b7c9-46cea36472b3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.712245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e5fa0-af4e-4bee-8876-80f40d1f4e99 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.744933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.745663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.745950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.746224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.758229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.760033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.761141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.763157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.763677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.764176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.774646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.776560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:47.779787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:47.780693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:47.781579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:47.781579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:47.781579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:47.781579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:47.781579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 319/622] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:47.782255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:47.797652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:47.798600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:47.799570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:47.805964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 304/623] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:47.805964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.896798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a797fb-4613-42fd-ba91-3e3ed105a499 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.898588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:47.935097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc946a5-7246-4e12-9be0-76c7419810c6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:47.942200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.944121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.944664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.945553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.959334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.961410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.978291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:47.979266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:47.979748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:47.980277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:47.981256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:47.981760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:47.982854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:47.983734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:47.984653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:47.984653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:47.984653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:47.984653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:47.984653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 320/624] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:47.985366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:47.986146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:47.998304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.004405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 305/625] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:48.005470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.093107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b16a23-fc69-4370-a0e0-28207b0650c0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.132470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.133124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.133411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.133688 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.134542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:48.134854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.136562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.147797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99200a8-beae-4732-8a78-c0f9dc5a9e2a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.165300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 321/626] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jun 24 06:57:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:48.165300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.188243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.197163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.198197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.198197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.198405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.199150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:48.199461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.200883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.213805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 306/627] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:48.214814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.278451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.283263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1b22b-bd71-4181-bd99-613c20bb48bb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.319922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.321147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.321512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96368fe3-0c96-4500-b446-35b20c5531a0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.321878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.322355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.330427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.332311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:48.348247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:48.349269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:48.350361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:48.353398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 322/628] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:48.354563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.358026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.359566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.359566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.359566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.371085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.373127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:48.391746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:48.392695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:48.393587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:48.393587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:48.393587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:48.393587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:48.397698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 307/629] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:48.398686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.434477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.465860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797c562-8793-4755-bfa8-9b01b8a4cc44 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.502051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.503221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.503387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.503757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.509388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e400896-1f26-4330-a06d-1c96ae0cbac8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.511543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.513170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.528292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:48.532684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:48.533593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 06:57:48.534541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:48.538820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 323/630] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:48.539920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.546832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.547520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.547802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.548107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.549436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:48.549760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.551261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.577081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 308/631] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:48.577081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.664475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280af21-21b8-413c-b6ba-3cf1bd3b4894 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.683295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7f58-bb54-44e8-a40c-c3333c787864 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.693297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.698421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.699087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.699366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.699636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.700386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:48.700691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.702084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.713167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 324/632] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:48.713929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.724141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.724822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.725104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.725382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.726279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:48.726583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.728369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231675b1-3371-4f63-b29b-2d586d71d31f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.748275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 309/633] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:48.749573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a9b4-6198-423c-bdbd-4f7a7a8b1e68 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.749863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a9b4-6198-423c-bdbd-4f7a7a8b1e68 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.750135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a9b4-6198-423c-bdbd-4f7a7a8b1e68 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.751365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 310/634] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:48.752437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b06c9-a830-4cf6-bc4f-5f0a39cba2b7 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.752720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b06c9-a830-4cf6-bc4f-5f0a39cba2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.752990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b06c9-a830-4cf6-bc4f-5f0a39cba2b7 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.754487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 311/635] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:48.755192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b06c9-a830-4cf6-bc4f-5f0a39cba2b7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.788406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.824261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b8cc9-e73e-42f3-b3c5-a1d24fe532e9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.859067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc4cf-6c15-4c29-a2b4-983b6b2c22c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.859725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc4cf-6c15-4c29-a2b4-983b6b2c22c8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.860038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc4cf-6c15-4c29-a2b4-983b6b2c22c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.860316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc4cf-6c15-4c29-a2b4-983b6b2c22c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.867095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b06c9-a830-4cf6-bc4f-5f0a39cba2b7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:48.900778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:48.901580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:48.901864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:48.902137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:48.908928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.910385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:48.919720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:48.924627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:48.925668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:48.926541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 312/636] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:48.927036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:48.933935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dc4cf-6c15-4c29-a2b4-983b6b2c22c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:48.935410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dc4cf-6c15-4c29-a2b4-983b6b2c22c8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.019240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.033397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2279-1fc9-4807-9a84-1c92e198bc9f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.036085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 325/637] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:49.037502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425057c-933d-4a08-aa50-fa7e9fc55bd5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.037797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425057c-933d-4a08-aa50-fa7e9fc55bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.038107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425057c-933d-4a08-aa50-fa7e9fc55bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.054747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d425057c-933d-4a08-aa50-fa7e9fc55bd5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:49.055996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d425057c-933d-4a08-aa50-fa7e9fc55bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:49.068665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.069328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.069641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.069916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.124770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 326/638] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:49.126337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.126627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.126904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.145592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.147038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.147276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:49.148640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:49.169573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.222259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 327/639] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:49.223028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.243535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.258709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 313/640] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:49.259999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.329589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966775d5-5c58-423b-aaa9-e1455ad31189 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.362091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be35e4-061a-41ae-949f-36f30709ebed None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.364587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.365368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.365652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.365923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.366800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:49.367111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.368600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.383067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 328/641] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:49.384111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.400575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.401713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.401713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.401937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.402015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.412766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.414284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:49.432450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:49.433642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:49.434608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:49.434608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:49.434608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:49.434608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:49.434608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 314/642] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:49.434608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.486936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.498079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0c02-184d-4e78-93a9-bef8cb4dd56a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.532060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.532862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.533140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.533409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.543665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:49.548965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dde634-0f0e-4bf6-b3aa-f0525f0689c5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:49.551470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:49.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 329/643] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:49.554141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.583484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.584325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.584627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.584905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.595429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:49.603706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:49.604681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:49.605582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 315/644] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:49.606373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.635144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.666006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b605b-7c87-4c85-9897-5ce258073d04 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.699891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.700697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.700980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.701265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.701406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.704259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af382b66-8032-45c1-a515-bf0c25f470df None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.712281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.713744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:49.734834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:49.735746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:49.736687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:49.736687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:49.736687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:49.736687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:49.737211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 330/645] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:49.738341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.741619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.742579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.742861 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.743135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f528585e29824f548ba7b76848bd0f57/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.758498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=f528585e29824f548ba7b76848bd0f57, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.759976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.772953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 316/646] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:57:49 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f528585e29824f548ba7b76848bd0f57/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:57:49.773684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.854826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1763-a2b3-466f-8f5d-16ad1d2ea3bc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.880974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:49.892279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.893247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.893247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.893518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.894260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:49.894566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.895992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.904425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70ae51-993d-4df0-af06-350175a9fe2f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:49.913198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 331/647] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:49.913198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.959007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:49.959679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:49.960045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:49.960318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:49.961068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:49.961391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:49.962728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:49.970862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 317/648] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:49.971653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:49.989626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.020607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941868-bd9b-4ef4-898c-d19d32ebe131 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.054589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.055367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.055546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.055814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.056594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.056902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.058316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.066293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 332/649] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.067079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.088153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d4ea1-32b4-425a-b24f-96307e9c4bda None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.114005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.125075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.125765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.126062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.126345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.127080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.127392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.128800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.142424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 318/650] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.143243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.179592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de38ef-a76f-4254-98ab-86e2075e6e2b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.214989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.215902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.216185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.216457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.222474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.223495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.224781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:50.240232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:50.241167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:50.242053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 333/651] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:50.242560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.256193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1c20-5a72-462a-ba57-491e93906656 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.292924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.293727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.294008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.294287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.304871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.306547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:50.327048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:50.328107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:50.329003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:50.329003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:50.329003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:50.329003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:50.329003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 319/652] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:50.329469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.353903 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e4422-98c9-479b-ab90-6cc556f28a2a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.364650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.397114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.398025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.398311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.398585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.409916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.411359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:50.433103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:50.434286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:50.435341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:50.435341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:50.435341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:50.435341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:50.435341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 334/653] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:50.435622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.439308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f0c85-f6c1-4e99-9b0c-9be61050193f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.463422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.475321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.476219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.476661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.476814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.486289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.488116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:50.502966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:50.503900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:50.504813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 320/654] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:50.505293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.554149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96fe3a-ec52-4cb6-a1d8-592b3a0b05f6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.588938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.589919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.590419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.590921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.591838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.592179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.593611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.610815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 335/655] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.611661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.613173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d930ab8-26dc-4e71-a029-27b4a7ebfb97 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.631802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.649335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.650001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.650279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.650549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.651268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.651571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.652977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.669716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 321/656] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.669716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.718384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.719181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df57113-8501-458d-9450-ef91d9ec9c1e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.757314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.758058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.758342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.758898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.759631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.760012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.761814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.772700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb180-ef10-4539-b36f-dda3d2fe1b89 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.781664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 336/657] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.781664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.809752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.810759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.811251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.811526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.812364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.812675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.814326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.826387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 322/658] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.827213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.871820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.896875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbd8e-3d38-4436-ba0e-e56d96ddf606 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.932260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.932919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.933206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.933479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.934312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f8f4b69c63f444d1997b3426cdf1eb00) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:50.934622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.934725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6d50-40ce-447f-8f4a-17c181c97c8f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:50.936079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:50.938050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:50.948396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 337/659] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/role_assignments?user.id=f8f4b69c63f444d1997b3426cdf1eb00&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:50.949997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:50.973078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:50.974296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:50.974296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:50.974479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:50.984515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:50.985901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:51.002051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:51.003055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 06:57:51.004037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:51.008701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 323/660] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:51.009092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.075455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc46c0-4408-4880-804c-0a7fafb60eac None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.117288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.118096 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.118373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.118642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.121846 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00fb3a-f6a5-4ff8-890c-714085eab307 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.128483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.129739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:51.152538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:51.153520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:51.154627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 338/661] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:51.155293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.162091 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.166091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.166757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.167034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.167300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.169130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=d928c6bee9f744c082c98811fcb35629) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:51.169130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.170636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.177942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 324/662] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/role_assignments?user.id=d928c6bee9f744c082c98811fcb35629&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:51.178774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.216005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.288738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05384-bcdd-4968-a723-6d4fb89c9e06 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.299914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7bcd-d03a-4579-b765-d37aeac3b70d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.328553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.329674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.330182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.330656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.331962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:51.332505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.334168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.336845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.337541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.337824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.338121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.338959 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:51.339267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.340817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.356656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 339/663] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:51.365106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.367878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 325/664] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:51.367878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.447040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.464226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.473018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738c04-116f-4b65-89f0-7216ca5c0524 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.489956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5862c-7bfc-4cb8-b0b9-c42663a0434c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.513172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.513842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.514128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.514406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.532098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.532765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.533046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.533316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.598777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.600718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.612725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.614228 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.683298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.715327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.730917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 340/665] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:51.737073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.737949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 326/666] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 06:57:51.739126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.838427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58385889-4f73-43fd-be9f-dadc915758f2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.856286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486b79-5426-4516-ad37-1f70fd69e036 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:51.873585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.874405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.874695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.874966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.885537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.887004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.894341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:51.895153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.895533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.895815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3d3deaf7-b6c7-456f-881a-39b2065a57f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:51.905089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:51.906014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:51.906904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:51.906904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:51.906904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:51.906904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:51.906904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 341/667] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:51.907195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:51.908409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb81a9-3da3-4ecd-afd8-12238987e7cb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.908610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:51.912335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb81a9-3da3-4ecd-afd8-12238987e7cb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.912616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb81a9-3da3-4ecd-afd8-12238987e7cb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.914148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 342/668] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:51.915232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb81a9-3da3-4ecd-afd8-12238987e7cb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c6716b3d-1ec7-4867-ab63-4afc293c3b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:51.929135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:51.930938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:51.936707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:51.936707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:51.936707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:51.936707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:51.937205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:51.937346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 327/669] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:51.940147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:51.940147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:51.940147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:51.956189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:51.957400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:51.992299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.024776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb81a9-3da3-4ecd-afd8-12238987e7cb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.030235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 328/670] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:52.031150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.059589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.060283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.060561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.060833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.061555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:52.061859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.063237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.074945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 343/671] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:52.075775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.139237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621c98-b250-4a4f-a456-7c5cc9fb21cb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.151188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.177498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.178449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.178945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.179373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.180435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:52.180885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.182410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.183115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c4ef-d6c2-447b-80ec-bfb0392f79b9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.199734 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 329/672] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:52.200986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.217565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.218373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.218653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.218924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.229894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:52.233895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:52.238102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:52.239052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:52.240003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 344/673] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:52.241821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.311709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31004d7d-d88e-40f1-9ee6-e0eab33a573f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.345133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14220-a70c-4c9c-b2ef-0b3e49185f60 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.347772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.348633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.348916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.349192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.356636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.358084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:52.372530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:52.374535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 330/674] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:52.377286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.396184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.396460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.396724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.404133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.405663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:52.420776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:52.422795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 345/675] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.424936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.471461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.483985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808d1f-2aed-48c6-8cfe-d152b6ec2d57 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.518503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5266-261f-416e-be17-d60108291e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.519182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5266-261f-416e-be17-d60108291e60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.519461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5266-261f-416e-be17-d60108291e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.519733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5266-261f-416e-be17-d60108291e60 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.520578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5266-261f-416e-be17-d60108291e60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:52.521152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5266-261f-416e-be17-d60108291e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.522349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5266-261f-416e-be17-d60108291e60 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.531035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 331/676] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:52.531979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5266-261f-416e-be17-d60108291e60 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.534098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21679c9-e94a-4666-9e9e-ff1878cba0e5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.571409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.572580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.573060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.573602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.574736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:52.575244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.576993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.594292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 346/677] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:52.595406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.632679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5266-261f-416e-be17-d60108291e60 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.652255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.666296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.666961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.667242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.667515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.668387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:52.668651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.670096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.687954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 332/678] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:52.688848 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.701372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.706174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325df4c2-ea3a-4b4a-b5f7-92c6e61b58ba None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.743224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.744440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.744943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.745448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.757444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.759151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:52.778044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:52.778977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:52.779914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:52.779914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:52.779914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:52.779914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:52.782328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 347/679] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:52.783386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.790741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187796-090a-4317-bccc-c6b094a43177 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.825487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:52.826145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:52.826428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:52.826702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:52.827546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=d6e8bab40c4b4f029d9ac7600d756797) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:52.827889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:52.829511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:52.841459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 333/680] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/role_assignments?user.id=d6e8bab40c4b4f029d9ac7600d756797&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:52.841459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:52.961153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.972292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0d7c6-eb2b-4ac2-a268-35c24e35adca None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:52.976160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:52.984188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd02b5-035c-49a0-a8af-473b731b826f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:53.026098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.026786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.027068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.027343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.028301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:53.028611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:53.030007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:53.043440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.044160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.044448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.044728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.045586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=4530cddbad6f4446beaf33a67135257e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:53.045900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:53.047376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:53.056908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 334/681] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:53.059578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 348/682] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:52 2022] GET /identity/v3/role_assignments?user.id=4530cddbad6f4446beaf33a67135257e&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:53.065057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:53.182073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77dcae-7e55-4566-bedb-cc0739259ffb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:53.227570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.228698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.228970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.229249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.236216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:53.242643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:53.246067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4e2192b4-3bbb-4b1d-a451-6c556ce79288 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:53.267125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:53.268189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:53.269104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 335/683] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:53.274053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:53.300768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4456-b1f8-4f0d-8a1a-9f0f66aa47ea None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.301077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4456-b1f8-4f0d-8a1a-9f0f66aa47ea None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.301336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4456-b1f8-4f0d-8a1a-9f0f66aa47ea None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.303519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 336/684] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:53.309682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.309976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.310253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.335054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:53.336754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:53.406019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2763f6-c4ee-4735-89d7-a58145df553c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:53.448506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 337/685] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:53.468573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.469647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.470152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.470632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.471714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:53.472256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:53.473434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:53.482654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:53.512116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 349/686] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jun 24 06:57:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:53.517385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:53.569724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:53.645591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4e4e0-bbf0-4149-8b5a-9868664de53e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:53.683758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:53.705194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.706133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.706420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.706694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.708888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd536c0-4d37-428e-9e5f-1f706a6875b4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:53.723190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:53.737917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:53.738876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:53.739721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 338/687] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:53.746820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:53.786389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc10bc-c35c-4911-90cb-0de795ab0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.787051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc10bc-c35c-4911-90cb-0de795ab0515 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.787337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc10bc-c35c-4911-90cb-0de795ab0515 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.787614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc10bc-c35c-4911-90cb-0de795ab0515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.916239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc10bc-c35c-4911-90cb-0de795ab0515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:53.917714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc10bc-c35c-4911-90cb-0de795ab0515 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:53.941043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7824c-e7b1-44a3-9bc1-235191782e60 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:53.970816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:53.994296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:53.994928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:53.995171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:53.995443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:53.996238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:53.996549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:53.998372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.007954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 339/688] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:54.013239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.065279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.074032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 350/689] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 06:57:54.075650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83715b-1000-4a23-8c66-4d5030a9d8e5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.075974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83715b-1000-4a23-8c66-4d5030a9d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.076259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83715b-1000-4a23-8c66-4d5030a9d8e5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.077851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 351/690] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:54.082754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.083111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.083307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.101339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:54.103418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:54.125494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b20ed9-6e74-438c-a34b-5df2d4e3e908 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.164176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.165682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.166157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.166605 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.182425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.184076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.192193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 352/691] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:54.193301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:54.203246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:54.204185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:54.205081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:54.205081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:54.205081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:54.205081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:54.205081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 340/692] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:54.210029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.276340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.318900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.322512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b512c68-d9c3-40a7-b219-bc579bd40a78 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.323377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c13dfb-29df-47f0-95d3-a2798f6a33b4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.358173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.359354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.359878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.360349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.360957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.361628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.361911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.362188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.362921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:54.363229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.364940 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.372754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.374478 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.378354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 341/693] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:54.379260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:54.394495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:54.395418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:54.396332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:54.396332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:54.396332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:54.396332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:54.403077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 353/694] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:54.404475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.489067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05c17-13ff-4dcc-b0fa-1361e937ba47 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.507310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417c42-dbf8-455b-9ff8-693e3efbe34b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.517090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.527246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.528364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.528834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.529274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.541117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.542873 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.546951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.547895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.548313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.548669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.556342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.557901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:54.566183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:54.567197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:54.568150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:54.568150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:54.568150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:54.568150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:54.570200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 342/695] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:54.571113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:54.578067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:54.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:57:54.580397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:54.582205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 354/696] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:54.583124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.587937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.684155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83744-bb71-4a93-b3bc-c71d63131e71 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.685094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898b7e-e906-4a4d-8fcf-d099cba86d85 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.718761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.719594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.720031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.720390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.721227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:54.721627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.723100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.724171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.725092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.725613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.726078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.727023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:54.727517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.729466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.741512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 355/697] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:54.742485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.743485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 343/698] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:54.744491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.775760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.823065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:54.853227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918473-7e64-406f-80a3-828c659f9eac None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.859948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b08c-b21b-4cfe-b638-596b4c5eac73 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:54.888602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.889402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.889752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.890095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.891009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:54.891385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.893017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.905201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061032b-9867-48e2-acde-91139c54617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:54.906541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061032b-9867-48e2-acde-91139c54617e None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:54.907141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061032b-9867-48e2-acde-91139c54617e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:54.907701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061032b-9867-48e2-acde-91139c54617e None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:54.908632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061032b-9867-48e2-acde-91139c54617e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:54.910310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061032b-9867-48e2-acde-91139c54617e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:54.911754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 356/699] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:54.912606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:54.935825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 344/700] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:57:54 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:54.937086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061032b-9867-48e2-acde-91139c54617e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.063102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061032b-9867-48e2-acde-91139c54617e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.096277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.101420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.115422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3664cb-2b78-47f1-a3dc-d1483a55a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.116719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3664cb-2b78-47f1-a3dc-d1483a55a83d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.117250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3664cb-2b78-47f1-a3dc-d1483a55a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.117723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3664cb-2b78-47f1-a3dc-d1483a55a83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.136786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d728-9637-4f08-ae41-184caacf7075 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.198639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.199737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.200045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.200315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.207565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.209645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.211294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3664cb-2b78-47f1-a3dc-d1483a55a83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.213170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3664cb-2b78-47f1-a3dc-d1483a55a83d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7d1452f5-c138-40f6-905f-4dd47e41e292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:55.231132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:55.232183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.233643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 357/701] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:55.238636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81214-c13a-4a96-8c8e-36686d9ce58f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.239142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81214-c13a-4a96-8c8e-36686d9ce58f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.239597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81214-c13a-4a96-8c8e-36686d9ce58f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.241306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 358/702] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:55.245841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81214-c13a-4a96-8c8e-36686d9ce58f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.338272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 345/703] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:55.339385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb622-00f9-40b3-919c-f6067297e51a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.339671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb622-00f9-40b3-919c-f6067297e51a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.340710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb622-00f9-40b3-919c-f6067297e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.358460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7b4fb622-00f9-40b3-919c-f6067297e51a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:55.359558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7b4fb622-00f9-40b3-919c-f6067297e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:55.360650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81214-c13a-4a96-8c8e-36686d9ce58f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.382565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.402310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.402983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.403257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.403530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.404346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:55.404651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.406075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.418577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 359/704] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:55.419284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.427627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.438950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 346/705] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:55.440162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7aa0-6a5f-42b9-86bc-0ea5066d761b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.440453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7aa0-6a5f-42b9-86bc-0ea5066d761b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.440731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c7aa0-6a5f-42b9-86bc-0ea5066d761b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.442159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 347/706] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:55.442675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7aa0-6a5f-42b9-86bc-0ea5066d761b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b294f8-8a99-4a84-8958-f23caf87cacf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.547466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c7aa0-6a5f-42b9-86bc-0ea5066d761b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.565730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.566565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.566847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.567145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.577812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.579270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.582206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.582858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.583136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.583406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.584262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f528585e29824f548ba7b76848bd0f57) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:55.584569 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.586157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5df93-3476-42b7-b723-1adf38532a25 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.600182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 348/707] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/role_assignments?user.id=f528585e29824f548ba7b76848bd0f57&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:55.600182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052165-74a4-414c-a88d-872735966d93 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.600182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052165-74a4-414c-a88d-872735966d93 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.600182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052165-74a4-414c-a88d-872735966d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:55.600670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:55.601474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:55.602361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:55.602361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:55.602361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:55.602361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.602361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 360/708] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:55.602361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.623745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6b052165-74a4-414c-a88d-872735966d93 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:55.625055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6b052165-74a4-414c-a88d-872735966d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:55.644050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.669529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.714295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 349/709] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:55.715886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b052165-74a4-414c-a88d-872735966d93 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.718695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de327c-ac8b-44ed-bc43-c3a489dee068 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.769470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.770539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.771127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.771397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.772292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.773818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:55.789451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:55.790585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:57:55.791582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.792363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 361/710] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:55.792493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.873848 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b052165-74a4-414c-a88d-872735966d93 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.914501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88f33f-db59-4194-bbb8-c293dd40fad3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:55.915635 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.916757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.917841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.918138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.918888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:55.919196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.920639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.935895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 350/711] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:55.936787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:55.949027 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.953382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:55.956915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:55.958111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:55.959132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:55.960099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:55.961212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:55.963046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:55.980162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:55.981099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:57:55.981942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:55.985539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 362/712] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:55.986608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:56.069459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dc398-61bc-4780-b309-e5437a419b1b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.114270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34da36c-e093-41d5-a93e-3df908611ebb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.114578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.115242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.115623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.116079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.117183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] RBAC: Adding query filter params (name=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:56.117611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.119992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.130866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 351/713] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:56.130866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:56.162523 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.163719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.164179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.164635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.172152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.174103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:57:56.191792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:56.192774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:57:56.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:56.196419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 363/714] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:56.197627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:56.221116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:56.250479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:56.252219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481745b6-e84b-4a3a-905d-fa5b8de8af6d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.287095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.288153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.288582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.288989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.289863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:56.290343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.291935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.297523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 352/715] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jun 24 06:57:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:56.298634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:56.310972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8df69-15ef-4dd8-8346-e8cc7986ad9c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.345604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.346471 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.346848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.347247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.348193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] RBAC: Adding query filter params (type=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:56.348596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.350251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.364110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 364/716] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:57:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:56.365166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:56.422299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412d14-19a5-4def-b041-017e68719bc5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.466344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.467275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.467690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.468152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.471431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:56.471998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.473615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.488222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:56.502601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 353/717] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:56.508042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:56.550616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994091be-fac8-4db5-8c4c-cca394441a69 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.564747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:56.594114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.594942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.595225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.595503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.596267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:56.596734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.598551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4bf2d-da5e-4ec1-9ee0-e15a4e743e35 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.604571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 365/718] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jun 24 06:57:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:56.667872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962420f9-b6b8-4af1-99d3-decccffa6286 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:56.708089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:56.708858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:56.709238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:56.709611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:56.710642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f8f4b69c63f444d1997b3426cdf1eb00) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:56.711052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:56.712645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a759a-7ff8-43e2-bf0c-da1c065f45c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:56.719830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 354/719] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:57:56 2022] GET /identity/v3/role_assignments?user.id=f8f4b69c63f444d1997b3426cdf1eb00&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:57.330418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f662d-dd2f-4040-880d-218b1467e3bb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:57.330841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f662d-dd2f-4040-880d-218b1467e3bb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:57.331020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f662d-dd2f-4040-880d-218b1467e3bb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:57.332414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 366/720] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:57.337929 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:57.338479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:57.338479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:57.360030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:57.361227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:57.455585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:57.468115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 355/721] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:57.502052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f662d-dd2f-4040-880d-218b1467e3bb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:57.649678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f662d-dd2f-4040-880d-218b1467e3bb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:57.692921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:57.694176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:57.694665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:57.695166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:57.716992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:57.725307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:57.726294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:57:57.727123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:57.729897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 367/722] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:57.735761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:57.925121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa8d80-cffe-4282-ae80-ed4f20ab4fd8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:57.970840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:57.971523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:57.971806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:57.972101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:57.972865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:57.973174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:57.974628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd684a-c6a1-4918-9dab-bd7d3bfffae7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:57.987485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 356/723] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:57.993014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.036488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e360a-f629-48a5-be0e-5ea6039608d6 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.036799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e360a-f629-48a5-be0e-5ea6039608d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.037058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e360a-f629-48a5-be0e-5ea6039608d6 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.038897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 357/724] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:57:58.045553 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.045854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.046266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.054433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:58.068029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:58.069761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:58.129035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:58.151434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 358/725] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 06:57:58.177948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.214072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1cb48-5412-4179-9d8a-50219cb260a2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:58.291705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9bfe-c1f2-40d4-aa16-3bcb9c03f09b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:58.329286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:58.330190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.330477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.330753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.341991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:58.343440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:58.344523 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.345025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.345502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:58.350051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:58.351035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:58.351946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 359/726] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:58.358120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.376731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:58.378285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:58.420201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:58.421258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:58.422265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:58.422265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:58.422265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:58.422265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:58.422488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:58.428009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 368/727] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:58.436742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.474202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c78cb6-7747-405b-aed8-516985bd4a75 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:58.512750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:58.514185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.514837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.515296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.516543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:58.517186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:58.518735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:58.528459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 360/728] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:58.534220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.651108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:58.657577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3b2be-0be0-4044-abad-d9ef47796a19 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:58.683127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09628a16-ca8e-4341-81be-1458de6ddfac None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:58.689495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:58.696433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:58.697799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.698262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.698707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.710641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:58.712438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:57:58.731721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:58.732673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:58.733580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:57:58.733580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:57:58.733580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:57:58.733580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:58.735938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 361/729] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:57:58.741724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.765181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:58.766223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.766223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.766442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.767148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:58.767458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:58.768877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9a7f-d80c-4b2e-a41a-8c95632c050a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:58.783199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 369/730] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:58.787957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132081-a666-41d5-b2b0-85c9b8c214ce None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.787957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132081-a666-41d5-b2b0-85c9b8c214ce None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.787957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132081-a666-41d5-b2b0-85c9b8c214ce None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.791048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 370/731] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:58.792234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.792623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.793002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.810880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:58.812359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:58.858068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0225e-5828-4e94-bf75-d3100574de88 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:58.892037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 371/732] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:58.893173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.895373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:58.896367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:58.896893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:58.897444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:58.898429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:58.898957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:58.900619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:58.914059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 362/733] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:57:58.919749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:58.940347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:58.993099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.017905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1850f4f-9692-467a-88ab-36c077f700bb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.031094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204cac-8a1d-4fe0-919f-8603d1c325f3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.054898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.055711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.056028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.056305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.064282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.065886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.070340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.071401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.071926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.072399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.080280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.081993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:59.082117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:59.082978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:57:59.083942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 372/734] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:59.088118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:57:59.105478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:59.106548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:57:59.107478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:59.114666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 363/735] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:59.116072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.195088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6671c-679c-479f-a056-b7070d748517 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.213728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.235160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.235918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.236117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127ac4-6fe0-431e-868b-89689bad4a15 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.236235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.236476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.237205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.238593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.242952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.255883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 373/736] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:57:59 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:57:59.257103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.288334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.289377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.289665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.289944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.290839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:59.291154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.293209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c2a7-6436-479f-a8e0-2c260d5073e7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.317484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 364/737] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jun 24 06:57:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:59.317484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952a61-fa29-44cf-9b5b-793379c40379 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.317484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952a61-fa29-44cf-9b5b-793379c40379 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.317484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952a61-fa29-44cf-9b5b-793379c40379 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.317484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 365/738] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:59.317962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403d85c-8036-47a9-b104-f2275142277a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.318454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403d85c-8036-47a9-b104-f2275142277a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.319307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403d85c-8036-47a9-b104-f2275142277a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.324008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 366/739] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:57:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:57:59.325022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403d85c-8036-47a9-b104-f2275142277a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.395000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1cad-f92a-4f07-86b0-b722dc803fc5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.433448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.434383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.434845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.435123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.436129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:57:59.436506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.437875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac0dd-08e7-4d91-b109-2d3dac01a236 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.442672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403d85c-8036-47a9-b104-f2275142277a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.456324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 374/740] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jun 24 06:57:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:57:59.457667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab85b-1b0e-4bab-9ff1-4d449f5a0a6d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.457956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab85b-1b0e-4bab-9ff1-4d449f5a0a6d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.458236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab85b-1b0e-4bab-9ff1-4d449f5a0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.474435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.475498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-976ab85b-1b0e-4bab-9ff1-4d449f5a0a6d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:59.476908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-976ab85b-1b0e-4bab-9ff1-4d449f5a0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:59.480936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.481587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.481864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.482134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.531504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.553074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.553851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 375/741] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:59 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:59.554743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.555448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.555921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.556329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.583743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:57:59.585893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:57:59.657998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 376/742] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:57:59 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 06:57:59.658785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.683248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 367/743] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:59 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:59.683248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.715005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.764960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ac41b-ce04-497a-a198-0ab29cb1ceaf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.779696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.799483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b510-88a8-4c36-aff2-6599919d1c5e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.801445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.802109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.802385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.802659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.834988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:57:59.835800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:57:59.836113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:57:59.836488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:57:59.847813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:57:59.855866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:57:59.856998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 368/744] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:57:59.857864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.877993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:57:59.879438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:57:59.954502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:57:59.964413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90177e0-bba3-477e-87f5-6aa611715df7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:57:59.984836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 377/745] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:57:59 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 06:57:59.984836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:57:59.998848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.010230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.010893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.011161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.011455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.012239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.013591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.035878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 369/746] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:57:59 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:00.035878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.095868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4457fd-0a34-4a35-8646-568d881760af None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.149420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.150607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.151020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.151434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.156240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713653-d948-40b3-8212-e84fad862977 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.165305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.167482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:00.187703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:00.188875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:00.189869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:00.189869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:00.189869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:00.189869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:00.192045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 378/747] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:00.193363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.200810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.201507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.201788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.202062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.202822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:00.203131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.205582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.214592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 370/748] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:00.215435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.232445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.267604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.324658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4dfa1-8da6-486c-9aaa-82f8836b103d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.335794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca138-2aaa-44f9-8ecc-4bd28287fe66 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.371119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.371978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.372264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.372544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.376207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.377073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.377494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.377911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.378782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:00.379231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.380854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.385604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.387115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.396619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 371/749] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:00.402443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:00.409361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:00.410432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:00.411387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:00.411387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:00.411387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:00.411387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:00.411387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 379/750] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:00.411791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.500563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.532665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb982d-bf05-4376-869f-e67c50600a61 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.535346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22681c-3b27-42a8-9e97-560c311aa87a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.551032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.576851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.578229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.578730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.579198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.581524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.582722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.583010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.583286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.587911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.589622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.594948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.596444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:00.608801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:00.609678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:00.610563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:00.617061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:00.617911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:00.618778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:00.618778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:00.618778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:00.618778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:00.619965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 380/752] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:00.620985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 372/752] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:00.621711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.621872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.747168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6a4ec-21bf-4a21-a899-685437e6f561 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.754918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b2c4-f7b9-4a32-b98a-ad6d737b4fdb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.779343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.791280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.792288 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.792576 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.792853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.793928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:00.794242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.796182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.801389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.802332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.802805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.803899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.804829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:00.805862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.807713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.811877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 373/753] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:00.811877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.829660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 381/754] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:00.830991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:00.876726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:00.933833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eeb2e-8a37-4b92-9d25-0ea3525fcbd2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.963297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001518-d4dc-45a3-8c15-d588a5999874 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:00.975478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:00.976187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:00.976471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:00.976753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:00.978115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:00.978421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:00.980089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:00.995934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 374/755] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:00.997046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.010140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.011661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.012171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.012672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.014482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=893b4543600e4327953f70952a03802d) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:01.014994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.017538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.030049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 382/756] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/role_assignments?user.id=893b4543600e4327953f70952a03802d&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:01.030049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.079596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:01.161072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152b2e-4014-4007-b40a-7077483f6c71 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.237646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.239008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:01.239489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.243813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.244499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.245578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58caf-9a20-4043-a4ec-fc374b3999c3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.255484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.257559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:01.274186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:01.275201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:01.276088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:01.278705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 375/757] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:01.284451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.321241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.322053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.323093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.323999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.334557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.336043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-40ee5f12-8436-4f0a-b5aa-6331bba330af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:01.350745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:01.351701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:01.353621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 383/758] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:01.354202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193213dd-7432-4202-ad6e-2254bb759fa4 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.354202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193213dd-7432-4202-ad6e-2254bb759fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.354540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193213dd-7432-4202-ad6e-2254bb759fa4 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.355880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 384/759] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:01.357530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193213dd-7432-4202-ad6e-2254bb759fa4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.413029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a0e89-1dae-439a-a346-5a0c21cd2ad5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.420699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:01.449372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a453-420d-4758-95bf-f40570e067de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.450042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a453-420d-4758-95bf-f40570e067de None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.450328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a453-420d-4758-95bf-f40570e067de None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.450607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a453-420d-4758-95bf-f40570e067de None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.451403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a453-420d-4758-95bf-f40570e067de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:01.451719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a453-420d-4758-95bf-f40570e067de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.453453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a453-420d-4758-95bf-f40570e067de None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.462334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193213dd-7432-4202-ad6e-2254bb759fa4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.467312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 376/760] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:01.468753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.469051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.469328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.491442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:01.492748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:01.506649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.507461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.507808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.508248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.509152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:01.509526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.511149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.529936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 385/761] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:01.530917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.556208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:01.568002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 377/762] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:01.569038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.654613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c43ee-42ec-4901-a309-de0f1fbf8c7b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.678332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:01.684986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680ba24-20c5-4258-818b-c1269b9be85a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.704889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.705561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.706360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.706646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.707765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f528585e29824f548ba7b76848bd0f57) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:01.708104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.710200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.718396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 386/763] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/role_assignments?user.id=f528585e29824f548ba7b76848bd0f57&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:01.719239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.737505 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.738332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.738616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.738882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.777040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.778519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:01.824142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:01.826239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:01.828385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:01.828385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:01.828385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:01.828385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:01.828385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 378/764] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:01.837374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:01.847823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d69ff7-491f-4835-9342-8f372c7be765 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:01.860295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:01.889295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:01.890317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:01.890606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:01.890887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:01.891567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:01.893725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:01.910484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:01.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:01.914245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 387/765] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:01.918119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.023723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b8ca3-7dae-4a92-94fb-a98acdca042e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.062974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.063642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.063944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.064217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.064939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:02.065243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.067051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.094193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 379/766] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:02.099648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.116975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.118816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344360-ca2d-4fea-b8bf-95d6b16c77a5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.179857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.180393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.180677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.180949 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.181667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] RBAC: Adding query filter params (name=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:02.181972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.183360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.193582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 388/767] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:02.196876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.224245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.303666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cafd0d-c068-4372-bf98-bca6c1e72874 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.343900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.345137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.345624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.346096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.347033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8d47-63a6-42f8-bb80-a5f92117179d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.354341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.356237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-97bbb93d-17c7-486b-92eb-722b3848a2ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:02.371045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:02.372194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:02.373086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:02.375515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 380/768] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:02.377313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375beb-5b38-48bd-9239-e13eb3bede5f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.378421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375beb-5b38-48bd-9239-e13eb3bede5f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.378924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375beb-5b38-48bd-9239-e13eb3bede5f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.384691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 381/769] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:02.384691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375beb-5b38-48bd-9239-e13eb3bede5f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.387975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.388890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.389383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.389850 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.390764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:02.391378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.392983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0666cc-a247-422d-b5ef-f5e361db1ec8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.399369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 389/770] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:02.400904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.401453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.402008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.420227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:02.421440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:02.456171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.493838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375beb-5b38-48bd-9239-e13eb3bede5f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.508195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 390/771] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:02.509387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.529691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.530405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.530772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.531102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.532015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:02.532416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.539951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.544206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.546775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 382/772] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:02.547663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.642822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1d162-c83e-478a-bb62-0b92ffd7a0e6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.659504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00d11-d334-45ee-9d73-6444e4393734 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.680800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.681733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.682196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.682793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.683933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] RBAC: Adding query filter params (interface=public, service_id=60a6c6231d884efbabf0614a3d7a7888, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:02.684509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.686086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.687460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.695877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.696773 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.697152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.697338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 391/773] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/endpoints?service_id=60a6c6231d884efbabf0614a3d7a7888&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:02.697479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.698247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.698678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.699752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:02.714603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:02.715585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:58:02.716455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:02.720795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 383/774] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:02.721693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.772384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.818378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedfb59-4c25-4e85-93aa-a9a09afd157d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.826460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8d954-4351-4d0f-ade6-d1a7a328c180 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:02.859836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.860959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.861310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.861658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f8f4b69c63f444d1997b3426cdf1eb00/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.863979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=f8f4b69c63f444d1997b3426cdf1eb00, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.865615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.868293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:02.869065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:02.869351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:02.869624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:02.870352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:02.872283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:02.878857 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 384/775] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:02.879703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:02.888053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 392/776] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:02 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f8f4b69c63f444d1997b3426cdf1eb00/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:58:02.948683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:02.999909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f730-0a1a-4c6a-b64d-273cab09be61 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:03.039130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:03.039872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.040167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.040478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.041195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:03.041500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:03.042878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:03.048493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 385/777] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jun 24 06:58:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:03.057308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:03.194460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea32e4-d172-4012-b2c0-23d409d0d8da None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:03.222925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:03.234265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:03.234948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.235231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.235505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.236367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:03.236675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:03.238056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd234c-6942-4b2b-ad47-2563ba56a29b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:03.243277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 393/778] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jun 24 06:58:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:03.249200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:03.267050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38752f-0ada-4618-9c2b-bcac7e54f41e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.267350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38752f-0ada-4618-9c2b-bcac7e54f41e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.267516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38752f-0ada-4618-9c2b-bcac7e54f41e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.269839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 394/779] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:03.275215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966b3d-a525-4c47-856b-452864737747 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.275667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966b3d-a525-4c47-856b-452864737747 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.276184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966b3d-a525-4c47-856b-452864737747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.300637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c5966b3d-a525-4c47-856b-452864737747 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:03.303250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c5966b3d-a525-4c47-856b-452864737747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:03.430441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 395/780] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:03.458633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d961c5-9d6d-4ad4-9e98-b8fb08dae10a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:03.486514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:03.492452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966b3d-a525-4c47-856b-452864737747 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:03.525675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:03.526614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.527096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.527515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.528530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] RBAC: Adding query filter params (interface=public, service_id=448320c98285400a88d207e01d834e91, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:03.528985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:03.531395 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:03.548963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 386/781] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:03 2022] GET /identity/v3/endpoints?service_id=448320c98285400a88d207e01d834e91&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:03.554465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:03.653400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966b3d-a525-4c47-856b-452864737747 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:03.674972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:03.691424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:03.692311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.692599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.692876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.703772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:03.711748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:03.712668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:03.713668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 396/782] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:03.719726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:03.751787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79df2da-c447-4b12-a1c7-12d881b466df None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:03.790621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:03.791303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.791623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.791918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.792610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:03.793989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:03.799677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 387/783] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:03 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:03.872566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91543912-b8d2-4a2d-a668-584238d11778 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:03.910087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:03.911048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.911509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.911966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.912985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:03.913450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:03.915022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb6b4d-6b2b-49f2-bf7d-f8f240e819e4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:03.924943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 397/784] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:03.935895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:03.987596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f5d11-465c-45d0-93f3-75cc05dae5d0 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.987914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f5d11-465c-45d0-93f3-75cc05dae5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.988206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f5d11-465c-45d0-93f3-75cc05dae5d0 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:03.989848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 398/785] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:03.995303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:03.995593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:03.995899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.013256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:04.014476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:04.029738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:04.056346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:04.091394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 399/786] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:04.121372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.134435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52519a6f-a0c5-4910-8ab0-a220c73fcf05 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:04.173164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:04.173973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:04.174253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:04.174528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.186346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:04.187909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:04.210900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:04.212028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:04.213256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:04.213256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:04.213256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:04.213256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:04.213256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 388/787] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:04.218588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.251902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8941b6-fbe6-4d8b-b6f5-154796010886 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:04.309187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:04.309932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:04.310218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:04.310495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.333166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:04.347090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:04.348106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:04.348940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:04.349786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 400/788] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:04.355781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.403329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:04.408759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:04.413889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053eb2-a5ff-456f-be58-ece276456eb2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:04.465786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:04.466494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:04.466780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:04.467058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.467794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:04.468130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:04.469574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:04.482991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 389/789] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:04.491619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.550806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa6325-ace6-4b21-985c-da7a2af267a6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:04.597115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5f800-a2a3-403c-8ccb-860d33ae5892 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:04.611872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:04.611872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:04.611872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:04.611872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.612251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:04.612251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:04.612251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:04.623187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 401/790] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:04.642690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.666183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:04.667020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:04.667304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:04.667578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.675264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:04.676837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:04.692805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:04.693749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:04.695448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 390/791] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:04.699472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.756246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:04.765710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:04.772453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf61b7-b0f5-4bb5-b287-db092a4ab4b4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:04.807547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:04.808393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:04.808902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:04.809037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:04.820417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:04.821930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:04.843721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:04.844713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:04.845579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:04.845579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:04.845579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:04.845579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:04.845579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 402/792] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:04.851564 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:04.964851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8086db7-044a-45ee-bcc4-3aa0fdef0d7e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.003539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.004370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.004662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.004936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.005671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:05.005978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.007391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.021236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 403/793] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:05.026662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.029536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b18ff-bfd0-473e-8397-3e851f019da2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.040206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.108634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.109235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.109517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.109790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.110641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:05.110947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.112419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.157536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 391/794] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jun 24 06:58:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:05.162871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.166885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc90f6-cef7-45ca-b65a-2f5101b15817 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.205843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.206806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.207092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.207367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.217210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.218900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:05.236189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:05.237123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:58:05.238062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:05.238584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 404/795] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:05.244711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.346996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.375095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644730-1565-4bac-89d0-dadb7246805a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.398504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.420061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.421343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.421628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.421905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.435542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.437893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.443148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf8ae-5bcf-4850-8507-a2c3764a0714 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ed480be4-bf7b-483c-a5c6-c3faff91ef33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:05.459352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:05.460382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:05.461269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:05.461269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:05.461269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:05.461269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:05.461269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 392/796] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:05.462227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324101f-7065-4d88-a2b4-bd36e61f6c01 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.462227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324101f-7065-4d88-a2b4-bd36e61f6c01 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.462494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324101f-7065-4d88-a2b4-bd36e61f6c01 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.463884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 393/797] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:05.466314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e631-52f8-46e0-b1ce-0d074946e3d9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.466314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e631-52f8-46e0-b1ce-0d074946e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.466314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e631-52f8-46e0-b1ce-0d074946e3d9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.466590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 394/798] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:05.467614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e631-52f8-46e0-b1ce-0d074946e3d9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.491057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.491739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.492356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.492356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.493164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:05.493476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.494906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7e0df-b971-4326-8723-8d224664a1f1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.516690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 405/799] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:05.516690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602356ac-b9d1-4699-833a-33ecf6f5c1d9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.516690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602356ac-b9d1-4699-833a-33ecf6f5c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.516690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602356ac-b9d1-4699-833a-33ecf6f5c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.532707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-602356ac-b9d1-4699-833a-33ecf6f5c1d9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:05.533892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-602356ac-b9d1-4699-833a-33ecf6f5c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:05.579565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e631-52f8-46e0-b1ce-0d074946e3d9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.609616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.612538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 406/800] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:05.614435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.615167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.616263 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.616812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.617325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.617904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.618539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.619370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:05.619711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.621149 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.633259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 395/801] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:05.633998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.637537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:05.639001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:05.691496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.709982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 407/802] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:05.711071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.754101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b2ac4-28a5-4ca4-9125-d52a4a8082ab None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.788481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.789296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.789554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.789820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.801241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.802674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.816724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93d60-28e4-45ad-9552-52597f176bfb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:05.819818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:05.820731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:05.826532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:05.826532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:05.826532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:05.826532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:05.826532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 396/803] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:05.826532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.858370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.859168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.859446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.859714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.869818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.873365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:05.882078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:05.883021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:05.883929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 408/804] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:05.884635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:05.932902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:05.935825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb1f42-8553-4ea4-b56a-5dd9a813d231 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:05.972781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:05.973858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:05.974137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:05.974412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:05.983557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:05.985109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:05.993395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6d534-53fa-4d55-a26a-c39816e9631e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:06.003356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:06.004436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:06.005309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:06.008206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 397/805] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:06.009201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.028877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.029689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.029977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.030256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] PATH_INFO: `/v3/services/network` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.031104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.032367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:06.044703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:06.045728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:06.046597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 409/806] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:05 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:06.047378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.132480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd26c-4ff5-4789-b9aa-b3886ade3d58 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.135391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.157622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c144b-0ba8-4df4-9849-9eced802ed3d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.169852 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.170839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.171799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.171944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.172166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.172918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.173233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.174623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.186493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 398/807] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.191341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.202310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.203229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.203229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.203517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.204306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.204613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.205980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.214576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 410/808] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.219779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.298840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e396e-56b8-4acf-ba89-b8b35fb4ed9e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.318273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db671f8-636e-4d2a-96ab-4225a9bcb985 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.332721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.333392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.333677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.333948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.334822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.335130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.336618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.349141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 399/809] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.349932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.350163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.350858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.351142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.351422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.352165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.352479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.354168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.358914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 411/810] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.359703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.376874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.399451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225759-4925-435d-a0c4-f5eaf6b2c994 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.465514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb88ed-d0b2-4569-970e-7306711da7d5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.488297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.489104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.489385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.489658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.496403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.497844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.498204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.499000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.499274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.499555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.509857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.511293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-feda9858-0fa6-4f00-9526-5a6f62eb285b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:06.511686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:06.512742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:06.513825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 400/811] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:06.514386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a030e-50b0-4823-8275-76018c3dac27 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.514509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a030e-50b0-4823-8275-76018c3dac27 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.514802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a030e-50b0-4823-8275-76018c3dac27 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.519887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 401/812] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:06.519887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a030e-50b0-4823-8275-76018c3dac27 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:06.529989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:06.530880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:06.531757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:06.531757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:06.531757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:06.531757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:06.531757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 412/813] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:06.532276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.605253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.619590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.624673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a030e-50b0-4823-8275-76018c3dac27 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.634852 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258d5e-0b1b-4c3f-80cf-aab97834d206 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.658018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfb48d-da67-4e4d-9a7e-02c030777490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.658836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb48d-da67-4e4d-9a7e-02c030777490 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.659120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb48d-da67-4e4d-9a7e-02c030777490 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.659394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb48d-da67-4e4d-9a7e-02c030777490 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/893b4543600e4327953f70952a03802d/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.668659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.669312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.669592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.669862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.670658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.670954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.672354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.673737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb48d-da67-4e4d-9a7e-02c030777490 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=893b4543600e4327953f70952a03802d, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.675167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb48d-da67-4e4d-9a7e-02c030777490 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.677387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 413/814] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.677909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.691160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 402/815] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:06 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/893b4543600e4327953f70952a03802d/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:58:06.692366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.692654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.692933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.711781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:06.713210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:06.791223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a8c62-8bad-4a43-baea-152752c92bc0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.804103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 403/816] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:06.804103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.844411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.845172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.845456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.845822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.846626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.846979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.848899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.862973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 414/817] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.863593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.877235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.882076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:06.921424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899997-b259-4dba-b03a-e8d2551a8eb0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:06.958358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:06.958757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:06.959039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:06.959315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:06.960101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:06.960409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:06.961887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:06.978452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 404/818] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:06.978452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:06.982884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe429d-debe-4834-b262-712c87ff2d0e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.019891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.020932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.021424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.021918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.023082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.024627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.050372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 415/819] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:07.051160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.105888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8700e-536a-4988-a6ea-96f9cf689477 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.134797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.156312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.166749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.167641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.168080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.168354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.169021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.170461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:07.185362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:07.186348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 06:58:07.187268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:07.191566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 405/820] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Jun 24 06:58:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:07.192597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.209770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d2766-724d-4b3e-a3c9-1133d2748576 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.252174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.253230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.253612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.253985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f528585e29824f548ba7b76848bd0f57/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.256129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=f528585e29824f548ba7b76848bd0f57, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.257744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.273277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 416/821] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:07 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f528585e29824f548ba7b76848bd0f57/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:58:07.276280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.318550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6b43-a49e-4d5f-8a33-5d1853e0eec7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.361096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.362383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.362928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.363405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.378406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.380172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:07.399941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:07.401145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:07.402315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:07.405840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 406/822] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:58:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:07.411811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.472654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.541565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070056a8-08a2-477c-a8f6-0ec19626e99d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.549131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdace75-f143-4c21-8e1e-c475437ff4b9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.583234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.585247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.586568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.586854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.587636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.589507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:07.589851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.592195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.595099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.596709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.597002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.597278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.598003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:07.598309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.599678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.606281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 417/823] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jun 24 06:58:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:07.612572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.614335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 407/824] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:58:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:07.619804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.714690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52ec0-ee7d-41c5-adf6-289543209712 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.720924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.724350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d6524-c3d4-4a6b-b907-50d06b997e4b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.751900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cab912-0796-4a86-999f-b64548346fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.752664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cab912-0796-4a86-999f-b64548346fab None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.752946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cab912-0796-4a86-999f-b64548346fab None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.753217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cab912-0796-4a86-999f-b64548346fab None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.753923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cab912-0796-4a86-999f-b64548346fab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:07.754225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cab912-0796-4a86-999f-b64548346fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.755900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cab912-0796-4a86-999f-b64548346fab None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.760363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.761022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.761304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.761560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 418/825] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jun 24 06:58:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:07.761676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.767447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cab912-0796-4a86-999f-b64548346fab None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:07.830221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.841803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.843901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.880514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cab912-0796-4a86-999f-b64548346fab None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:07.923760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:07.924934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:07.925218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:07.925490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:07.926231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:07.928222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:07.950067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:07.953968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 419/826] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:07.959512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 408/827] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:07.960626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:08.088640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fcca1-423e-4471-84ab-69c288143b2a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:08.098978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:08.128348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:08.129184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.129462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.129732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.140869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:08.142310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:08.160153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:08.162048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:08.163342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:08.163342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:08.163342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:08.163342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:08.163342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 420/828] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:08.167681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:08.276542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9b15-7a56-445a-ad75-49d4fe6141be None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:08.312522 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:08.313564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.314068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.314537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.315462 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:08.316007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:08.317594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:08.330390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 409/829] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:08.336973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:08.448398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094136-cc6b-499a-b010-1ff8195e56af None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:08.486218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:08.487044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.487328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.487604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.495441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:08.496938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:08.511494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:08.512421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:08.514398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 421/830] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:08.518764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:08.582414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:08.629529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a24c5-4cbe-47a2-a2b3-6a393723175a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:08.664714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:08.665722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.666205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.666672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.667666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:08.668192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:08.669827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370aef-6dbb-4f05-a9eb-cb5ae639e4ae None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:08.684815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 410/831] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:08.695930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:08.711711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:08.771105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efc2c-7480-46c1-9eb3-03794030d016 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.771426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efc2c-7480-46c1-9eb3-03794030d016 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.771657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efc2c-7480-46c1-9eb3-03794030d016 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.773383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 411/832] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:08.778256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.778539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.778810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.799141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:08.800623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:08.801591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1826fe-9d41-4b6a-8fce-7d6ff37a9ca0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:08.840675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:08.841337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:08.841614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:08.841930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:08.842764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f8f4b69c63f444d1997b3426cdf1eb00) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:08.843183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:08.844697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:08.851890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 422/833] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:08 2022] GET /identity/v3/role_assignments?user.id=f8f4b69c63f444d1997b3426cdf1eb00&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:08.884004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 412/834] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:08.907789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:08.998099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:09.018175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a33ef-4dd3-4fb9-8206-4706fb0b1ea8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.055631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.056467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.056741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.057005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.067450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:09.075613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:09.076567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:09.077417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 423/835] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 06:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:09.082881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.141577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:09.195275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdad33a-2968-471d-bb25-29116b6013ed None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.233162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.233837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.234113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.234380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.235124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:09.235425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:09.236963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:09.245887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 413/836] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:09.251366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.352145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fdd58-d148-45b4-9a2c-66060adf5598 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.387442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.387442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.387442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.387442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.398420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:09.399806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:09.402448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6157cdb2-0dae-40e0-9b8c-3cc7753a44fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:09.418181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:09.419123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:09.420025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:09.420025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:09.420025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:09.420025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:09.425150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.425404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 424/837] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:09.440032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3bf5-d536-427d-b715-0556afcc0c81 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.440326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3bf5-d536-427d-b715-0556afcc0c81 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.440611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3bf5-d536-427d-b715-0556afcc0c81 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.442225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 425/838] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:09.447163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.447475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.447756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.465354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:09.466548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:09.543996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 426/839] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:09.550985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc0c32-b2b0-4f95-ab4d-7dd2e7beeb6e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.564216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:09.570567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.589848 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.590928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.591414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.591911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.592863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:09.593423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:09.595012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:09.681849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba558-15c2-4b9e-8281-3fc3b4609b7c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.708883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:09.721365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.722176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.722452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.722721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.728636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 414/840] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:09.734244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.734398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:09.742390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:09.743342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:09.744208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 427/841] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:09.749272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.857488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab380a-ff0e-4c0a-bf91-3b2271a2945d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.873084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7b16-63e2-42b3-9aee-04f79736fc27 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:09.899701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.901656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.902382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.902866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.912272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:09.913215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:09.913891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:09.914176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:09.914453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:09.914846 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:09.915205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:09.915513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:09.917276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:09.931397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 428/842] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:09.932406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:09.933083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:09.933991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:09.934937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:09.942937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 415/843] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:09.944095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:09.987706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:09.989571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.050123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9c66-818b-43a5-94ec-73f8eb34cba1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.075963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7923e-a41f-4469-aaa6-198bf386cf21 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.096220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.097127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.097932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.098301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.112020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.112695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.112971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.113237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.113341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.114072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:10.114373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.114711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.115829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9742c-45be-4de6-b2ae-d59abf9ef333 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.135070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 416/844] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:10.135742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:10.136644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:10.137541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:10.137541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:10.137541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:10.137541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:10.137772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e707f-e291-4ee2-8b9d-0b360caa1aac None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.137772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e707f-e291-4ee2-8b9d-0b360caa1aac None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.137772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e707f-e291-4ee2-8b9d-0b360caa1aac None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.140071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 417/845] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:10.140907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e707f-e291-4ee2-8b9d-0b360caa1aac None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.141545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 429/846] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:10.142601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.238684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.246819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.250685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee12667-0047-462b-ae67-46578db07068 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.252108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e707f-e291-4ee2-8b9d-0b360caa1aac None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.292281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.292694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.293158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.293158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.293443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.294282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.294712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.295121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.296026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:10.296329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.297762 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c466f-22e5-4099-aa5b-8f594db564df None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.310368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 430/847] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:10.312242 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.312532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.312802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.330250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:10.331446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:10.381164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.382563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.404644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 431/848] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:10.405502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.491817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.502928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.506809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 418/849] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:10.507960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.521794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a8512-c3d2-43b8-90ef-0eb479e900f3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.558006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.558923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.559230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.559525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.567154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.568624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:10.583130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:10.584137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 06:58:10.585396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:10.589011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 432/850] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:10.589716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.621378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e962c6e-406a-42f0-99c6-d2c7b6eb7bab None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.658444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.659489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.659763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.660058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.660708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.662387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:10.676315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:10.677408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:10.678240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 419/851] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:10.679871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.706022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351c2b7-c8e7-4fe9-905d-784df7cdeb9d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.740685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.742183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.743558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.743832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.744144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.754689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.756164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.765276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:10.775418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:10.776548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:10.777550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:10.777550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:10.777550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:10.777550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:10.782469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 433/852] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:10.783147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.796079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9626b0-2a6d-48be-a3b1-c7af81c30362 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.831494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.832183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.832565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.832834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.833662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:10.833963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.835438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.854016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 420/853] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:10.859115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.884966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb52f5-e2e1-43f1-918d-68bc504dfbe9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.919048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:10.919715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:10.920017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:10.920283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:10.920982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:10.921282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:10.922642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:10.927055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 434/854] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:10.927814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:10.967760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152400c-a697-46dc-9b00-51d652c5bb18 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:10.984587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:10.996236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.009751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.010419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.010695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.010962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.011688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:11.012026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.013383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.024778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 421/855] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:11.025649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.036653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead9ab0-f32f-48a4-b1bc-3c35cb88c0aa None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.071429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aaa7b-89db-4072-8f5b-052b514dd562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.072110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aaa7b-89db-4072-8f5b-052b514dd562 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.072387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aaa7b-89db-4072-8f5b-052b514dd562 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.072654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aaa7b-89db-4072-8f5b-052b514dd562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.121347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622860b7-c8c8-435f-9fb3-fa27a54e582f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.142683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970aaa7b-89db-4072-8f5b-052b514dd562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.144186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970aaa7b-89db-4072-8f5b-052b514dd562 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.153804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.154472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.154754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.155025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.155725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:11.156057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.157394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a245d-06fa-411a-b7fd-a996799b76e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.163080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 422/856] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:11.164311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292981-e39c-4049-881a-673427af6f3c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.164607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292981-e39c-4049-881a-673427af6f3c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.164863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292981-e39c-4049-881a-673427af6f3c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.166058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 423/857] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:11.166761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5292981-e39c-4049-881a-673427af6f3c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.218582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.225392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.269388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 435/858] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:11.270623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.270911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.271183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.289137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:11.290349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:11.297660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5292981-e39c-4049-881a-673427af6f3c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.337310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.338701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.339084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.339463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.347439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.349037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:11.364630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:11.365565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 424/859] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:11.371446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.372033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 436/860] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:11.372033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.476204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.481840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.485674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f7c90-73e3-4fd3-8952-99d73fbc222c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.488362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033465e9-e69b-43c2-a24b-b02522ff54ad None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.520641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.521227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.521509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.521783 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.522647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:11.522958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.524345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.524461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.525144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.525424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.525698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.536055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.537575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.541220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 437/861] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:11.542093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:11.557799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:11.558765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:11.559643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:11.559643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:11.559643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:11.559643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:11.559643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 425/862] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:11.560587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.663598 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d673f4-ec66-4bfd-9997-2f2175875386 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.666781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522d2d-3b5c-4597-95a3-93636ff6b7f8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.698983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.699478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.699937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.700221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.700320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.700496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.700606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.700763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.701154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.701581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=893b4543600e4327953f70952a03802d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:11.701891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.702617 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.703299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.717205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 426/863] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/role_assignments?user.id=893b4543600e4327953f70952a03802d&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:11.717205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:11.717460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:11.718596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:11.719455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 438/864] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:11.723123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.735854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.746124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:11.843484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ed62-d18e-4947-8320-78581dc31719 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.866785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0cc4a-40ba-44c3-a332-79215b0c8425 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:11.888512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.889820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.891073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.891431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.892509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:11.892893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.895122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.906532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:11.907427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:11.907928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:11.908344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:11.909106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 427/865] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:11.909475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:11.909960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:11.911576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:11.914542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:11.918291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 439/866] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:11.923433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:12.002103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:12.026399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:12.040100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9d1f4-21e7-48aa-a84d-ef4fcdb3f508 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:12.053413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef442db-4bd7-42c6-b15e-fbc2af4735cd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:12.075538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:12.076377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:12.076646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:12.076933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:12.083863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:12.085374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:12.100690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:12.101583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:12.102640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 428/867] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:12.106026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:12.106993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:12.107420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:12.107821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:12.108033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:12.108942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:12.109416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:12.111262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:12.118474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 440/868] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:12.224149 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218debf-5c5e-4a52-b192-93c60fdd7b60 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:12.260732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:12.267262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:12.268319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:12.268786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:12.269266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:12.270264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:12.270755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:12.272649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28ef8-3175-4210-97ba-48639e73468b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:12.285887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 429/869] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:12.292105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:12.414672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9117-6238-40a3-a1e2-4bcf487539a5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:12.448624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:12.449277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:12.449556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:12.449828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:12.450665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f528585e29824f548ba7b76848bd0f57) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:12.450973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:12.452438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0171f-8b51-4208-a944-2f281f4c7f01 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:12.458823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 441/870] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:12 2022] GET /identity/v3/role_assignments?user.id=f528585e29824f548ba7b76848bd0f57&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:13.173508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a840f-ee79-40bd-85bf-29ed7414cb82 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:13.174039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a840f-ee79-40bd-85bf-29ed7414cb82 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:13.174039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a840f-ee79-40bd-85bf-29ed7414cb82 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:13.175868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 430/871] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:13.181146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1e3a-8659-4abd-b0c1-3c400752c618 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:13.181502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1e3a-8659-4abd-b0c1-3c400752c618 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:13.181864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1e3a-8659-4abd-b0c1-3c400752c618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:13.198881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-372d1e3a-8659-4abd-b0c1-3c400752c618 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:13.200074 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-372d1e3a-8659-4abd-b0c1-3c400752c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:13.203775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:13.276886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 442/872] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:13.298669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a840f-ee79-40bd-85bf-29ed7414cb82 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:13.415486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a840f-ee79-40bd-85bf-29ed7414cb82 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:13.448985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fcc52-6ebd-4bbf-85e8-b191e2e75a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:13.449578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fcc52-6ebd-4bbf-85e8-b191e2e75a9d None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:13.449859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fcc52-6ebd-4bbf-85e8-b191e2e75a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:13.450129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fcc52-6ebd-4bbf-85e8-b191e2e75a9d None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:13.450868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fcc52-6ebd-4bbf-85e8-b191e2e75a9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:13.452260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fcc52-6ebd-4bbf-85e8-b191e2e75a9d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:13.466869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 431/873] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:13 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:13.966696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7705-1932-45c1-890c-2784fccadccb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:13.967234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7705-1932-45c1-890c-2784fccadccb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:13.967540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7705-1932-45c1-890c-2784fccadccb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:13.969299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 443/874] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:13.974660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fd945-3a48-46fd-aa03-930b9635f1da None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:13.975058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fd945-3a48-46fd-aa03-930b9635f1da None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:13.975477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fd945-3a48-46fd-aa03-930b9635f1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:13.992923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c15fd945-3a48-46fd-aa03-930b9635f1da None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:13.994122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c15fd945-3a48-46fd-aa03-930b9635f1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:14.043715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.070898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 432/875] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:14.094549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7705-1932-45c1-890c-2784fccadccb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.163032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b78b8-b6e2-4b89-b37a-509316105364 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.163353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b78b8-b6e2-4b89-b37a-509316105364 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.163590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b78b8-b6e2-4b89-b37a-509316105364 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.165273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 433/876] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:14.170057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.170366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.170643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.187277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:14.188487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:14.206885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7705-1932-45c1-890c-2784fccadccb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.244480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.245348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.245627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.245894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.254600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.259603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:14.268238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:14.269174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:14.270590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:14.271424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 434/877] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:14.271522 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 444/878] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:14.275138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.286327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.375165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef1497-205d-47fe-9a51-0d24dc3125fd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.384867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.395811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ef6a4-d428-4886-b811-f6d04db476e3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.410342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.411019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.411298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.411569 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.412430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:14.412799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:14.414177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:14.428726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 435/879] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:14.429740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.432477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c92587-87ca-40c3-a70f-cd01583acb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.433370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c92587-87ca-40c3-a70f-cd01583acb5f None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.433782 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c92587-87ca-40c3-a70f-cd01583acb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.434157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c92587-87ca-40c3-a70f-cd01583acb5f None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.434978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c92587-87ca-40c3-a70f-cd01583acb5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:14.436473 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c92587-87ca-40c3-a70f-cd01583acb5f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:14.460079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 445/880] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:14 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:14.546060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be805d3-350d-4821-9558-b2bb60c777da None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.562864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7190f-5042-4e72-9f81-5d26b0af1fa1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.563292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7190f-5042-4e72-9f81-5d26b0af1fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.563666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7190f-5042-4e72-9f81-5d26b0af1fa1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.565563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 446/881] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:14.572297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.572951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.573487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.591344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.592211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.592468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.592751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.593809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:14.595384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:14.605049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:14.607494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:14.626442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:14.627430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:14.628355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:14.628355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:14.628355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:14.628355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:14.632543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 436/882] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:14.633461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.654352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.666161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.687875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 447/883] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:14.703508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.751784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3254f2-8ff1-49ee-a169-4e489e5625ad None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.792991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.794036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.794543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.795110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.796122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:14.796635 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:14.798315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:14.811978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 437/884] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:14.817821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.827674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18ab9-2d33-4961-813d-35da4ec37b39 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.872605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.873453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.873741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.874018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:14.874686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:14.876838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:14.893316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:14.894332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:14.895195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:14.899801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 448/885] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:14.901132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:14.918960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.946767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09398-b6ab-446f-b4ca-24ab3af217b9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:14.984050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:14.992456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:14.993970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:14.994694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:14.995147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.005393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.007155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:15.026791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:15.027774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:15.028737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:15.034492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 438/886] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:15.034699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.045615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f06b-a5ee-4a88-89ae-2eb0027c4562 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.089868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:15.090999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.091291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.091571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.092376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:15.092693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.094843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.107052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 449/887] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:15.108825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.163989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab48fc-26bb-4198-b71e-64c629532bcb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.201418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:15.202219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.202406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.202678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.203529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:15.203839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.205415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.214049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:15.217876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a31a-429a-4781-a268-a63280794f1b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.225944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 439/888] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:15.231666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.242244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:15.264375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:15.265104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.265394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.265819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.266691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:15.267004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.269249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067ae8d-1bfd-4ae4-bfd4-c48700a6dbda None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.279940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 450/889] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:15.358853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1c1a8-1300-4382-a604-81a785b9f3a3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.404224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:15.405330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.405812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.406295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.475968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:15.484424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.485899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.493231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1388-0acf-4597-93a9-57ccc4ad02f4 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.493516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1388-0acf-4597-93a9-57ccc4ad02f4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.493794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1388-0acf-4597-93a9-57ccc4ad02f4 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.495295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 451/890] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:15.500800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.501341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.501813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.519795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:15.521393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:15.592529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 440/891] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 06:58:15.597550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.619261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 452/892] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:15.641778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.706744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:15.714992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ead8d0-5ca2-4cea-9d0e-3605b3658e9a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.755163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:15.755993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.756301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.756655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.771692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e565-58f8-4f1b-b499-c65a88654dbb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.772026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.773465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.788535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:15.798334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:15.799246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:15.800161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:15.800161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:15.800161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:15.800161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:15.803979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 441/893] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:15.806449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.822912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:15.824008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:15.824291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:15.824562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:15.825223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:15.826760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:15.841420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:15.842441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:15.843277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:15.847548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 453/894] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:15.848428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:15.955122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87108e1-dfcb-4a78-a68b-f98cf06de0e3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.967469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d4348-f398-4fbc-afb2-30ea7c06ddbb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:15.999414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.000796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.001460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.001879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.003013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:16.003878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.005993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.008685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.009881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.010257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.010627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.011435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:16.011836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.013392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.024862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 454/895] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:16.025344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 442/896] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:16.025960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.026551 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.044652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:16.073162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:16.137978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7a89-74c7-4db5-957e-d0df8fba17c0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.141359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e159b-eb97-4c54-acfb-92289f854705 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.175343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.176393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.176588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.176956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.177317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.177681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.178111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.178576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.179446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:16.179996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.181632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.185192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.186689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.187626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 455/897] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:16.192936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:16.210828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:16.212062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:16.212947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:16.215927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 443/898] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:16.217546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.310223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:16.316935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c97dc-e8b9-43b9-ae84-c824c0dd621f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.320195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:16.348352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9de2-4f13-44fa-8a91-8f159768dfdc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.366965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.368465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.368956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.369964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.374453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] RBAC: Adding query filter params (interface=public, service_id=f9077dbf81414091b40da42d2643dc55, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:16.374937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.377307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.384407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.385362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 456/899] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/endpoints?service_id=f9077dbf81414091b40da42d2643dc55&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:16.389564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.389977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.390412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.390894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.391476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:16.391900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.393548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.419827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 444/900] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:16.420621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.528404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92bae9-ffcc-4c5a-951d-3fd72b30803d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.532608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59cc78-eecd-4bbc-ac54-2517b9e2de58 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.563907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:16.569884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99243906-2e42-4b59-93d6-f63c9ff50f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.570684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243906-2e42-4b59-93d6-f63c9ff50f98 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.571018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243906-2e42-4b59-93d6-f63c9ff50f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.571303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243906-2e42-4b59-93d6-f63c9ff50f98 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.572010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99243906-2e42-4b59-93d6-f63c9ff50f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.573374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99243906-2e42-4b59-93d6-f63c9ff50f98 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.573698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.574514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.574800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.575354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.576231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] RBAC: Adding query filter params (role.id=6eae7e2272544a9088fa415a97b76a4b, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=893b4543600e4327953f70952a03802d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:16.576688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.578111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.579458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 457/901] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 06:58:16.583892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366bd2a-50d3-4bfa-9737-cc1f712e60b1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.583892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366bd2a-50d3-4bfa-9737-cc1f712e60b1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.583892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366bd2a-50d3-4bfa-9737-cc1f712e60b1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.583892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 458/902] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:16.588451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 445/903] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/role_assignments?user.id=893b4543600e4327953f70952a03802d&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=6eae7e2272544a9088fa415a97b76a4b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:16.590009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.590461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.590875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.611144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:16.612775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:16.645432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:16.700417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 459/904] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:16.723465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.831090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b45e5d-bcaa-42dc-8888-7e64534b7f3d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:16.866421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:16.867247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:16.867523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:16.867798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:16.868547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:16.869969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:16.882567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:16.883702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:16.884581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 446/905] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:16.889731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:16.991199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d7d6-4530-46e3-b64b-3659d67dad5d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:17.025989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:17.026697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.026937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.027209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.027947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:17.028254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:17.029622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:17.034916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 460/906] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:17.040529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:17.104278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:17.151887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8629c7-7a7e-4bb8-8d94-04304d791182 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:17.187481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:17.188177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.188501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.188775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.189480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:17.189781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:17.191145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:17.196465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 447/907] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:17.202296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:17.231023 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:17.305090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c384c-e6a1-4c40-9568-7163a2c7a02b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:17.339691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:17.340385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.340662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.340934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.341794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] RBAC: Adding query filter params (interface=public, service_id=ddc5bc6faddd4fc9a7c5390e7350723b, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:17.342103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:17.343524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ff99a-ea79-48c1-b391-f06413032ade None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:17.349198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 461/908] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:17 2022] GET /identity/v3/endpoints?service_id=ddc5bc6faddd4fc9a7c5390e7350723b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:17.355195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:17.375592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c61fd-4249-4760-866f-3d8b74ff658e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.375905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c61fd-4249-4760-866f-3d8b74ff658e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.376183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c61fd-4249-4760-866f-3d8b74ff658e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.377820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 462/909] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:17.389029 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.389306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.389897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.407082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:17.408882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:17.478106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 463/910] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:17.487255 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b52b1-00af-4944-8549-860a50324103 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:17.501140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:17.507629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:17.522985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00acfe-3b89-45d2-b65b-c7a6575575dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:17.524011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00acfe-3b89-45d2-b65b-c7a6575575dc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.524490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00acfe-3b89-45d2-b65b-c7a6575575dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.524983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00acfe-3b89-45d2-b65b-c7a6575575dc None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.526070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:17.526941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00acfe-3b89-45d2-b65b-c7a6575575dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:17.528981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00acfe-3b89-45d2-b65b-c7a6575575dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:17.536508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 448/911] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:17 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 06:58:17.620825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010036d-4c6f-4412-92ac-546436b3b84d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:17.664740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553544d8-68f9-4f03-b3b8-1e10f5ac0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:17.665472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553544d8-68f9-4f03-b3b8-1e10f5ac0508 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:17.665758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553544d8-68f9-4f03-b3b8-1e10f5ac0508 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:17.666032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553544d8-68f9-4f03-b3b8-1e10f5ac0508 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:17.666774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553544d8-68f9-4f03-b3b8-1e10f5ac0508 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:17.668194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553544d8-68f9-4f03-b3b8-1e10f5ac0508 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:17.684527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 464/912] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:17 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:18.652655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31158cb-aff7-4537-8bbf-439ec1ca6729 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:18.653671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31158cb-aff7-4537-8bbf-439ec1ca6729 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:18.654177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31158cb-aff7-4537-8bbf-439ec1ca6729 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:18.656105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 449/913] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:18.661729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a722c-2ef5-45db-94fb-71b044d682e1 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:18.662606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a722c-2ef5-45db-94fb-71b044d682e1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:18.663084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a722c-2ef5-45db-94fb-71b044d682e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:18.681270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8a8a722c-2ef5-45db-94fb-71b044d682e1 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:18.682854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8a8a722c-2ef5-45db-94fb-71b044d682e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:18.756883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 465/914] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:18.769094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca35c4-7e22-4e48-add3-ef21a6302c17 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:18.769628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca35c4-7e22-4e48-add3-ef21a6302c17 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:18.770127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca35c4-7e22-4e48-add3-ef21a6302c17 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:18.771955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 450/915] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:18.777101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:18.777396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:18.777836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:18.778636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca35c4-7e22-4e48-add3-ef21a6302c17 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:18.788938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:18.796788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:18.797991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:18.872251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 466/916] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:18.903043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:18.908159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca35c4-7e22-4e48-add3-ef21a6302c17 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:18.952004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:18.953338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:18.954104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:18.954527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:18.969450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:18.981002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:18.982181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:18.983302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:18.986517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 451/917] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jun 24 06:58:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:18.992783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.013228 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b7481-bffd-4efe-bc90-b87f5859b1e4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.047894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.048726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.049006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.049278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.049938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.051314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.051429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.055650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:19.067628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:19.068755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:19.069597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 467/918] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:19.075362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.130697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60042bb7-6c95-42d0-89ac-224a0dde199f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.176671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.178222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.178957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.179433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.181012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:19.181580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.183191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.196800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf946b-bc36-4db1-841a-53ee32c4dd0d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.197093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 452/919] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:58:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:19.206097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.240128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.240892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.242014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.242307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.243013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:19.243321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.244723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.251494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 468/920] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:19.257456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.315715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3212-d1c9-4c1e-94b7-aac94d1fa2fa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.323454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.329666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.352540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.353785 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.354124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.354465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.366295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.367614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.386711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e79889-8805-448c-bd7e-079de8548c0e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:19.390088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:19.391168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:19.392187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:19.392187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:19.392187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:19.392187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:19.395749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 453/921] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:19.396663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.433515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.434109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.434445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.434653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.435363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:19.435875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.437182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.447104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 469/922] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:19.448120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.538509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e8c63-fddc-4463-a768-fcd632a4343b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.556517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64557a2-ecdb-44bb-99de-e299db6f6826 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.584300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.589166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.589836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.590110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.590377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.591100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:19.591399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.592913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c71e07-d2c4-488a-8987-8905062a3d28 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.598532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ca841-7adf-4c13-af42-293c2f836584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.599475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ca841-7adf-4c13-af42-293c2f836584 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.600604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ca841-7adf-4c13-af42-293c2f836584 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.601106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ca841-7adf-4c13-af42-293c2f836584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.602599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ca841-7adf-4c13-af42-293c2f836584 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.604803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ca841-7adf-4c13-af42-293c2f836584 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.609951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 454/923] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:19.611335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb2923-913a-4a27-8d14-bef8967aa99c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.611618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb2923-913a-4a27-8d14-bef8967aa99c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.611941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb2923-913a-4a27-8d14-bef8967aa99c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.613181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 455/924] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:19.613865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb2923-913a-4a27-8d14-bef8967aa99c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.635629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 470/925] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:19.635629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.635629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.635629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.643052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.655312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:19.656686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:19.740154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 471/926] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:19.757719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb2923-913a-4a27-8d14-bef8967aa99c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.763725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.809002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.809832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.810118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.810396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.821004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.822390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:19.838867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:19.840116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:19.841070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 456/927] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:19.845672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.884155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937359-16f2-4239-94a3-891f11d7078a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.895075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.920818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.921635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.921910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.922178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.922830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:19.924215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:19.928934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-02979231-73c2-4ce3-bb03-69c2f325f940 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:19.937060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:19.938019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:19.938840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 472/928] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:19.939675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f38ce-9f33-402f-b12d-0bbb78827ee6 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.939744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f38ce-9f33-402f-b12d-0bbb78827ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.940365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f38ce-9f33-402f-b12d-0bbb78827ee6 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.941406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 473/929] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:19.944953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f38ce-9f33-402f-b12d-0bbb78827ee6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:19.956726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dd6a2-3234-4139-9aae-7e847cb31bf5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:19.996239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:19.996926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:19.997331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:19.997597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:19.998382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:19.998698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.000151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36372e-5d74-4f10-a9a2-e39ea2c2d85f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.026157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 457/930] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:20.026157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.026157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.026157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.042681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:20.043973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:20.053823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f38ce-9f33-402f-b12d-0bbb78827ee6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.089765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.090437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.090718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.090994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.091710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:20.092073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.093454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.098803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 474/931] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:20.104300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.113799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 458/932] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:20.121297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.146706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:20.198667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:20.215918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36352c-0b43-45ab-8085-98fddb5e7ca3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.237795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad089-b5b4-49bd-a473-85d63a60034f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.249958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.250698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.250982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.251255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.262561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.264286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.270990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534250c-c228-49df-876f-0997a567c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.271654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534250c-c228-49df-876f-0997a567c325 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.271985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534250c-c228-49df-876f-0997a567c325 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.272260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534250c-c228-49df-876f-0997a567c325 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.272963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534250c-c228-49df-876f-0997a567c325 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:20.273265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534250c-c228-49df-876f-0997a567c325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.274611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534250c-c228-49df-876f-0997a567c325 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.283948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 459/933] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:20.283948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534250c-c228-49df-876f-0997a567c325 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:20.284161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:20.284956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:20.285940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:20.285940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:20.285940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:20.285940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:20.285940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 475/934] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:20.285940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.385632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:20.400147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fda47-7704-4bd5-9809-1080f40ee10e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.405799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534250c-c228-49df-876f-0997a567c325 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.456234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:20.460835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.461823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.462323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.462819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.463525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.464067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.464373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.464646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.464912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.465573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.466519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.466919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:20.481291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:20.482799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:20.483689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:20.488189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 460/935] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:20.489052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.493608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 476/936] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:20.494786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.707485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649369-c827-48af-bc65-dc3ba2fbe7eb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.718043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47fd0-c9ba-4242-acbf-af6005241ad8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.759308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.760021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.760855 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.761127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.762034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:20.762340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.763719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.772134 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.772809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.773090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.773360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.774077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:20.774380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.775754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:20.785708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 461/937] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:20.790986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.795564 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 477/938] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:20.802145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:20.817578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:20.899646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:20.948487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417830-3359-45d6-839f-06cacecde096 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.957864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a95b-aa07-4881-97c4-f3c6e208ae7b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:20.986026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:20.986830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:20.987243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:20.987708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:20.988650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:20.989060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:20.990524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:21.000999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 478/939] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:21.002401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:21.007319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:21.008407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.008903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.009356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.016844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:21.018479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:21.033259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:21.034181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:21.035099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:21.042249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 462/940] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:21.043337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:21.081623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:21.122381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90d7d-41c9-409f-bcaf-99e09330d6a3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:21.161742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90996300-5866-4303-a482-4f4482181cd5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:21.172219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:21.172904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.173387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.173496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.174210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] RBAC: Adding query filter params (interface=public, service_id=2f406f6db7494805bb963e703ea45004, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:21.174522 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:21.175910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:21.185862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 479/941] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:21 2022] GET /identity/v3/endpoints?service_id=2f406f6db7494805bb963e703ea45004&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:21.186734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:21.192220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:21.200853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:21.202023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.202523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.203250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.204452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:21.204998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:21.206837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:21.226089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 463/942] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:21.227331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:21.289825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865070ba-9a8c-474b-b521-142bd24029d3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:21.323781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c8215-d036-467f-bdd1-7ce236d6ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:21.324521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c8215-d036-467f-bdd1-7ce236d6ea9e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.324882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c8215-d036-467f-bdd1-7ce236d6ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.325170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c8215-d036-467f-bdd1-7ce236d6ea9e None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.325844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c8215-d036-467f-bdd1-7ce236d6ea9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:21.327211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c8215-d036-467f-bdd1-7ce236d6ea9e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:21.328622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:21.339536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb4c2f-368e-4213-88aa-0eb2d04f76a0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:21.340128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 480/943] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:21 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 06:58:21.390368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee6b9d-c43c-4cec-9bf4-f1c6acbcd43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:21.391682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6b9d-c43c-4cec-9bf4-f1c6acbcd43d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.392199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6b9d-c43c-4cec-9bf4-f1c6acbcd43d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.392696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6b9d-c43c-4cec-9bf4-f1c6acbcd43d None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/893b4543600e4327953f70952a03802d/roles/6eae7e2272544a9088fa415a97b76a4b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.395360 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee6b9d-c43c-4cec-9bf4-f1c6acbcd43d None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=893b4543600e4327953f70952a03802d, role_id=6eae7e2272544a9088fa415a97b76a4b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:21.397267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee6b9d-c43c-4cec-9bf4-f1c6acbcd43d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:21.413648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 464/944] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:21 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/893b4543600e4327953f70952a03802d/roles/6eae7e2272544a9088fa415a97b76a4b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:58:21.783891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f7e4-5812-4d0a-958d-01de9ab5c7e5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.784417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f7e4-5812-4d0a-958d-01de9ab5c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.784494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f7e4-5812-4d0a-958d-01de9ab5c7e5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.786083 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 481/945] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:21.791568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:21.792100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:21.792182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:21.808847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:21.810041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:21.841123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:21.883555 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 465/946] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:21.906546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f7e4-5812-4d0a-958d-01de9ab5c7e5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:22.013622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f7e4-5812-4d0a-958d-01de9ab5c7e5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:22.047540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:22.048235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:22.048513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:22.048780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:22.049504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:22.050937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:22.052332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING keystone.server.flask.common [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 06:58:22.070524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.sql.core [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 06:58:22.070524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 06:58:22.070524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [parameters: {'id': '4a53ebedc54f4a68aab04f4c2b9a869b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 06:58:22.070524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80366) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a53ebedc54f4a68aab04f4c2b9a869b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a53ebedc54f4a68aab04f4c2b9a869b. Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 06:58:22.078427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 06:58:22.079227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application yield resource Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise self.value Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application session.commit() Jun 24 06:58:22.080398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.flush() Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application compat.raise_( Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 06:58:22.082346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 06:58:22.083989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 06:58:22.088509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [parameters: {'id': '4a53ebedc54f4a68aab04f4c2b9a869b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.089422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:22.090203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a53ebedc54f4a68aab04f4c2b9a869b. Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:22.091092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 482/947] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Jun 24 06:58:21 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:22.091656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:22.198971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67787e-ca63-49e3-9686-1fcee513a56e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:22.236441 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:22.237638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:22.238134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:22.238624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:22.246108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:22.247864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9e1c7d53-9bbe-4eb1-8059-ed9798552ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:22.262290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:22.263159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:22.264061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:22.266483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 466/948] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:22.272415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:22.329342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:22.381423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81148313-c540-462b-a901-9f6fc5152b79 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:22.417357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:22.418021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:22.418301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:22.418571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:22.419335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:22.419638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:22.421302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715b7e-6c99-4bea-9871-3189c43d1c83 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:22.441699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 483/949] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:22.654019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807468-85d4-404b-8b62-e0f16332b319 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:22.654368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807468-85d4-404b-8b62-e0f16332b319 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:22.654535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807468-85d4-404b-8b62-e0f16332b319 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:22.656057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 467/950] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:22.661659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:22.661920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:22.662211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:22.682036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:22.683562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:22.754851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 484/951] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:22.776888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72807468-85d4-404b-8b62-e0f16332b319 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:22.804479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:22.888608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72807468-85d4-404b-8b62-e0f16332b319 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:22.923721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:22.924817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:22.925235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:22.925656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:22.926446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:22.927998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:22.940492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:22.941724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:22.942757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:22.945195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 468/952] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:22.951889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.020234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:23.058808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1b76-6ba5-43a2-b1f6-2b64f28d1beb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:23.093626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:23.094295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.094567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.094839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.095548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:23.095864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:23.097244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844e5b-d9d9-4082-9442-6a5db8b080e8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:23.103050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 485/953] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:23.108941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.203960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:23.219117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a84e-638f-459b-86f5-ba2eef1cb8e1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:23.254757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:23.255421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.255694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.256002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.256827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:23.257131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:23.258496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d08faf-c38d-4413-b4b2-743db2439f0a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:23.263598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 469/954] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:23.457868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45893a-8da5-4530-a5f9-bd5cb1d23b3c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.458048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45893a-8da5-4530-a5f9-bd5cb1d23b3c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.458326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45893a-8da5-4530-a5f9-bd5cb1d23b3c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.460084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 486/955] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:23.465377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cdb32-eadc-40ce-98cd-2b0efcede20c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.465667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cdb32-eadc-40ce-98cd-2b0efcede20c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.465944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cdb32-eadc-40ce-98cd-2b0efcede20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.484069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e93cdb32-eadc-40ce-98cd-2b0efcede20c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:23.485257 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e93cdb32-eadc-40ce-98cd-2b0efcede20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:23.558183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba0094-e310-43ae-a74d-35e46fad1d2a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.558830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba0094-e310-43ae-a74d-35e46fad1d2a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.559308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba0094-e310-43ae-a74d-35e46fad1d2a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.559951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 470/956] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:23.561366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 487/957] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:23.566743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.567276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.567767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.577592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba0094-e310-43ae-a74d-35e46fad1d2a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.585411 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:23.586866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:23.670490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 471/958] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:23.693373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.697780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba0094-e310-43ae-a74d-35e46fad1d2a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:23.708640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:23.709845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:23.740106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:23.741261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.741681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.742092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.742895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:23.744312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:23.756714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:23.757882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:23.758770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 488/959] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:23.764657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.814776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6832c-5049-4c57-a3b7-0248bee08e96 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:23.859515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498542-d1a8-4655-a391-db650221c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:23.860540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498542-d1a8-4655-a391-db650221c430 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.860913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498542-d1a8-4655-a391-db650221c430 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.861244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498542-d1a8-4655-a391-db650221c430 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.872573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498542-d1a8-4655-a391-db650221c430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:23.879381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242e86-e788-48a6-ac6b-a059d108379c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-52498542-d1a8-4655-a391-db650221c430 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:23.881764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:23.882705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:23.883552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:23.888017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 472/960] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jun 24 06:58:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:23.888998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498542-d1a8-4655-a391-db650221c430 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.914654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:23.915321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:23.915600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:23.915894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:23.916696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:23.917097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:23.918473 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:23.924032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 489/961] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:23.932777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:23.972323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:23.974110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:24.016104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498542-d1a8-4655-a391-db650221c430 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.051464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b6974-3a4d-4023-b514-20a476bcad4a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.056513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.057194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.057479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.057756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.058574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:24.058886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.060358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.072178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 473/962] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:58:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:24.074437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.093409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.094597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.095053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.095493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.096392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:24.097338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.099116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.111057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 490/963] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:24.112976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.187102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc1b58-e3b7-4d99-9e57-17a5122a2c8e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.226834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:24.228070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.229044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.229412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.229769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.231907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ab9f-56e1-4740-9bc4-58da6102a94b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.232032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:24.243115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.244785 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:24.262934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:24.264066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:24.264965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:24.264965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:24.264965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:24.264965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:24.269680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 474/964] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:24.270779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.272911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.273795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.274284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.274737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.275673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.277256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.308145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 491/965] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:24.414169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295a16-ed0f-4cfb-90be-eb7997b3662e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.458206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.458883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.459162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.459531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.460293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:24.460596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.461990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.475447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 475/966] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:24.481820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.586769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7adfd-3d92-49a7-b066-bd3cf033956f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.621012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.621836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.622113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.622389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.630577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.632476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3fcfe6e6-ea3b-44a6-a2e3-98285a97522b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:24.647551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:24.648562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:24.649916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 492/967] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:58:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:24.654868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.683220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404cb8-ff3a-40bf-b71c-ceebfeb0a071 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.683543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404cb8-ff3a-40bf-b71c-ceebfeb0a071 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.683769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2404cb8-ff3a-40bf-b71c-ceebfeb0a071 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.685703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 493/968] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:24.691261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.691734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.692170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.707038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:24.709491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:24.710914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:24.724853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:24.773079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0d91c-4695-4f66-a9c0-373af5353922 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.793743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 494/969] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:24.815379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.816828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.817677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.818177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.818489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.819511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:24.820044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.822788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.845705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 476/970] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jun 24 06:58:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:24.851783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:24.936474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c9b0-6516-4853-be0c-f3f66469f312 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.971629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:24.973235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:24.974534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:24.975306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:24.975306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:24.976147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:24.977711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:24.978413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4fea-7588-4824-a19a-ccf27c4b86c2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:24.993911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.sql.core [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 06:58:24.993911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 06:58:24.993911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [parameters: {'user_id': '24776b7da0e34fb9b3810a228b98f0bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 06:58:24.993911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80366) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jun 24 06:58:25.006246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 06:58:25.007125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application yield resource Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise self.value Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application session.commit() Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 06:58:25.013022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.flush() Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application compat.raise_( Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 06:58:25.013918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 06:58:25.014789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 06:58:25.015628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [parameters: {'user_id': '24776b7da0e34fb9b3810a228b98f0bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:25.018063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 06:58:25.019931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 495/971] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jun 24 06:58:24 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:25.023151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.031763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.038587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.039249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.039527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.039797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.112517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.113967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.139551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c9218-7bbc-460e-89cd-ef9048d10f08 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.177612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.178937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.179410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.180021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.188874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.190955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:25.208425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:25.209533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 06:58:25.210518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:25.217813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.218975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 496/973] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:25.220181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.221418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 477/973] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:25.222445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.290043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.322938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5fc6-a8d5-4639-92fd-cd146f40c3e9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.326708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52231cfb-c6a5-4e9f-9208-896e032de59d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.356845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.357647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.357931 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.358205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.363449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.364332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.364855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.365126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.365996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:25.366298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.367823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed865c-6af5-4099-839f-f149b333cb98 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.368441 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.369886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1f30776c-f775-4f1d-9e24-a3fab023ea62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:25.392732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:25.393680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:25.394557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:25.394557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:25.394557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:25.394557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:25.394557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 478/974] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:25.395465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a7323-386d-4dc9-90f0-cdacdb752397 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.395564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a7323-386d-4dc9-90f0-cdacdb752397 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.395759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a7323-386d-4dc9-90f0-cdacdb752397 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.397226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 479/975] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:25.400741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a7323-386d-4dc9-90f0-cdacdb752397 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.424372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 497/976] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jun 24 06:58:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:25.429967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.430926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.431647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.452548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:25.454242 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:25.469320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.535821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a7323-386d-4dc9-90f0-cdacdb752397 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.537857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 498/977] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:25.565472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.586112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.587212 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.588196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.588682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.589877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:25.590547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.592771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.608613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 480/978] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:25.614320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.628736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.680660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc4b2-c067-46f2-8f67-1d3f451d50d7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.724633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.725423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.725710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.726239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.728138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.729563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.743839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ba4e-4985-459b-baa3-107e76af5b11 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.748002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 499/979] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:25 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:25.786779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.787769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.788095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.788515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.792272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.802611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.804557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:25.824414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:25.825824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:25.827270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:25.830545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 481/980] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:25.831980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:25.946982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a683a7-bb41-41bf-909c-6bbe255ffe6e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:25.964223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:25.984272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:25.984998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:25.985225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:25.985498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:25.986347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:25.986661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:25.988118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f29d8-3d6f-4a6e-a932-b8386f009295 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:26.001391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 500/981] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:26.007322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:26.112374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b31f0-a30c-4d0d-89cc-56110d067dcb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:26.148251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:26.148914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:26.149199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:26.149475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:26.150312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] RBAC: Adding query filter params (role.id=6eae7e2272544a9088fa415a97b76a4b, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=893b4543600e4327953f70952a03802d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:26.150623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:26.152086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870012b2-d12f-4cb0-9ffa-cbc44c3d8a60 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:26.160749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 482/982] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:26 2022] GET /identity/v3/role_assignments?user.id=893b4543600e4327953f70952a03802d&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=6eae7e2272544a9088fa415a97b76a4b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:26.430264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accaf4f-8ddd-4f61-a5c5-b0813b854fb8 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:26.430525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accaf4f-8ddd-4f61-a5c5-b0813b854fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:26.430837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accaf4f-8ddd-4f61-a5c5-b0813b854fb8 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:26.432380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 501/983] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:26.437387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:26.437680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:26.437916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:26.455637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:26.456849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:26.485745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:26.528387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 483/984] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:26.550620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accaf4f-8ddd-4f61-a5c5-b0813b854fb8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:26.660477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accaf4f-8ddd-4f61-a5c5-b0813b854fb8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:26.694213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:26.695156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:26.695530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:26.695924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:26.696685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:26.698141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:26.712530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:26.713711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:26.714750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:26.716705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 502/985] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:26.722498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:26.823181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1efa-8023-44e9-9a5e-f4763a5cc9f0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:26.857904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:26.858559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:26.858862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:26.859127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:26.859884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:26.860195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:26.861654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:26.867690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 484/986] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:26.873234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:26.915362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:26.973613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e2b8e-dca2-4fdc-9ab9-4b7656fc085d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:27.006774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:27.007553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:27.007958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:27.008319 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:27.009149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:27.009548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:27.011003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:27.016211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 503/987] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:27.021883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:27.050833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:27.126014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7f154-1657-44fd-945a-c8c1f80259b6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:27.160915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:27.161747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:27.162158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:27.162590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:27.163480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] RBAC: Adding query filter params (interface=admin, service_id=2f406f6db7494805bb963e703ea45004, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:27.163894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:27.165352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e5dac-f635-45ab-8baf-ccf8ed9bcbea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:27.170727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 485/988] 10.222.0.27 () {56 vars in 1249 bytes} [Fri Jun 24 06:58:27 2022] GET /identity/v3/endpoints?service_id=2f406f6db7494805bb963e703ea45004&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:27.176096 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:27.281089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f581f-cfb8-40c9-ac32-169207c63149 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:27.283549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:27.316829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc002eac-dc5f-458c-908a-7a9848ca52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:27.317574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002eac-dc5f-458c-908a-7a9848ca52e5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:27.317914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002eac-dc5f-458c-908a-7a9848ca52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:27.318247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002eac-dc5f-458c-908a-7a9848ca52e5 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:27.319089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc002eac-dc5f-458c-908a-7a9848ca52e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:27.320602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc002eac-dc5f-458c-908a-7a9848ca52e5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:27.327077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 504/989] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:27 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 06:58:27.781466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee786b8-9948-41bb-b33e-8de515e996b0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:27.781867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee786b8-9948-41bb-b33e-8de515e996b0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:27.782068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee786b8-9948-41bb-b33e-8de515e996b0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:27.783432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 486/990] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:27.788820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:27.789116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:27.789397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:27.806979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:27.808203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:27.880272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 505/991] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:27.902800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee786b8-9948-41bb-b33e-8de515e996b0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.000581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:28.012847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee786b8-9948-41bb-b33e-8de515e996b0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.047106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.047944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.048226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.048492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.049150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.050678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8824b1a9-ea13-4bdb-b177-a0f44d6b3382 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:28.062760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:28.063738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:28.064621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:28.068175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 487/992] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:28.069878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.171128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:28.175964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002e113-62c1-44ad-b1ff-f00fb09034d9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.181636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748364-be53-49d4-ac37-8d02d84cecc4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.181884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748364-be53-49d4-ac37-8d02d84cecc4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.182195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748364-be53-49d4-ac37-8d02d84cecc4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.183719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 488/993] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:28.188536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.188817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.189090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.206701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:28.207915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:28.212631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.213308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.213587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.213856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.214562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:28.214868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.216282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.221854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 506/994] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:28.227190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.278832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 489/995] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:28.300558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.333510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf78bc7-905d-43da-aaf1-88e5d2f32dc8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.375352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.375352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.375352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.375352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.375786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:28.376114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.377327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.388020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 507/996] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:28.390692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.402960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:28.419351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:28.421990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787912e-8b2d-4ed3-aa4c-0f2dbf8254dd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.456056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.456856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.457130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.457409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.458071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.459485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:28.471280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:28.472340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:28.476919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 490/997] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:28.479053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.502872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad78c5-8850-4b2c-8a03-e4925b51f1d5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.540425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.541089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.541562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.541672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.542408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] RBAC: Adding query filter params (interface=public, service_id=ea8fb7e6430c441cac32361f891388a5, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:28.542716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.544104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.553663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 508/998] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/endpoints?service_id=ea8fb7e6430c441cac32361f891388a5&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:28.554535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.584305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab78b9-b65d-4206-8f1f-54f48c09a22b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.618759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.619427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.619709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.620085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.620799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:28.621103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.622467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.627209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 491/999] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:28.632793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:28.647177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:28.650712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:28.662876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223d7a-94b9-4a98-aefc-53e2bbc3f6f9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.700751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0b80-76f1-4ec0-bdb8-b06975dc72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.701538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0b80-76f1-4ec0-bdb8-b06975dc72d3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.701822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0b80-76f1-4ec0-bdb8-b06975dc72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.702124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0b80-76f1-4ec0-bdb8-b06975dc72d3 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.702798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e0b80-76f1-4ec0-bdb8-b06975dc72d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.704186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e0b80-76f1-4ec0-bdb8-b06975dc72d3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.711638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 509/1000] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 06:58:28.736859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702f52-353c-41e6-9ca2-3843f4d362fd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:28.774762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:28.775444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:28.775716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:28.776017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:28.776731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] RBAC: Adding query filter params (type=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:28.777036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:28.778490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197b06-b96e-451c-b5d2-d20aa86e9050 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:28.792001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 492/1001] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:29.319497 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24323643-1c7f-4834-86eb-8ba1328f2d51 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:29.320066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24323643-1c7f-4834-86eb-8ba1328f2d51 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:29.320066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24323643-1c7f-4834-86eb-8ba1328f2d51 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:29.321604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 510/1002] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:29.326750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:29.327177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:29.327282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:29.344542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:29.345701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:29.420258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 493/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:29.443444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24323643-1c7f-4834-86eb-8ba1328f2d51 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:29.557206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24323643-1c7f-4834-86eb-8ba1328f2d51 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:29.590440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:29.591172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:29.591445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:29.591714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:29.592388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:29.593781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:29.605956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:29.606926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:29.612679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 511/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jun 24 06:58:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:29.615212 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:29.624072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:29.715514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcefe36-d2fa-4ef0-aef2-48604e414424 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:29.749383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:29.750050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:29.750327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:29.750600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:29.751304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:29.751608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:29.752998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:29.758115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 494/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:29.763745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:29.783814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:29.870709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd422e-1c91-4d82-b3b6-88bb92de2c13 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:29.907945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:29.908618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:29.908900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:29.909169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:29.909874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:29.910176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:29.911551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220dabb-da54-418f-a592-28684b21a479 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:29.919928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 512/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jun 24 06:58:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:29.922956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:29.996381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:30.027393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8832e-91f6-43a4-9641-4598f967d72b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:30.061442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531633f-d49e-4f87-832e-c6b2b2d081d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:30.062091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531633f-d49e-4f87-832e-c6b2b2d081d5 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:30.062366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531633f-d49e-4f87-832e-c6b2b2d081d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:30.062636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531633f-d49e-4f87-832e-c6b2b2d081d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:30.063367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531633f-d49e-4f87-832e-c6b2b2d081d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:30.064745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531633f-d49e-4f87-832e-c6b2b2d081d5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:30.087887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 495/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:30.725392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a95b22-5098-4015-b6f7-468bd67526f8 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:30.725920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a95b22-5098-4015-b6f7-468bd67526f8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:30.725920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a95b22-5098-4015-b6f7-468bd67526f8 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:30.727397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 513/1008] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:30.732811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:30.733244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:30.733322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:30.751964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:30.753144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:30.776903 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156e8e-8180-4da2-bbf3-c6281d0ac506 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:30.777251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156e8e-8180-4da2-bbf3-c6281d0ac506 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:30.777483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156e8e-8180-4da2-bbf3-c6281d0ac506 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:30.779005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 514/1009] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:30.783624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:30.783944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:30.784231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:30.800905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:30.802074 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:30.831145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 496/1010] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:30.854452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:30.870785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 515/1011] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:30.892937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:30.906498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:30.910677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:30.954901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48597-37be-4416-804f-6aca9dae554e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:30.990234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:30.990999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:30.991279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:30.991550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:30.992273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:30.993644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:30.998477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babad134-03e2-4989-ab2c-8f69636c7f58 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:31.005438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:31.006442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:31.007284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 497/1012] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:31.012534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:31.038531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:31.039195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:31.039480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:31.039752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:31.040510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:31.041860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:31.056952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 516/1013] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:30 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:31.137294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19a40-75d2-45eb-82ee-fc0965e83ab2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:31.159796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:31.184413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:31.185099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:31.185372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:31.185645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:31.186366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:31.186664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:31.188070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:31.194026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 498/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:31.199603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:31.275458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:31.308815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b6362-2f71-4369-8bdc-bdc446419df2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:31.343339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:31.344028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:31.344307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:31.344575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:31.345284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:31.345587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:31.346959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed8b8-f224-43ad-abf4-759d04afb8bf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:31.352073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 517/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jun 24 06:58:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:31.357896 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:31.465633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4aca1-c572-479a-8144-afd19eadb6c6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:31.501236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb8490-de98-49da-bc83-2f92587f78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:31.501901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8490-de98-49da-bc83-2f92587f78e5 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:31.502182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8490-de98-49da-bc83-2f92587f78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:31.502455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb8490-de98-49da-bc83-2f92587f78e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:31.503194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb8490-de98-49da-bc83-2f92587f78e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:31.504604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb8490-de98-49da-bc83-2f92587f78e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:31.529286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 499/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:32.089537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce5bd-90ee-4b4e-ae0a-0019c519e8d0 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:32.090077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce5bd-90ee-4b4e-ae0a-0019c519e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:32.090077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce5bd-90ee-4b4e-ae0a-0019c519e8d0 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:32.091438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 518/1017] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:32.097005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:32.097423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:32.097516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:32.115040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:32.116322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:32.146221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:32.195904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 500/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:32.218645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ce5bd-90ee-4b4e-ae0a-0019c519e8d0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:32.324955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ce5bd-90ee-4b4e-ae0a-0019c519e8d0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:32.358736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fb206-d3f7-41af-ac36-1cc7d8e63994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:32.359459 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb206-d3f7-41af-ac36-1cc7d8e63994 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:32.359742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb206-d3f7-41af-ac36-1cc7d8e63994 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:32.360053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb206-d3f7-41af-ac36-1cc7d8e63994 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:32.361232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fb206-d3f7-41af-ac36-1cc7d8e63994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:32.362674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fb206-d3f7-41af-ac36-1cc7d8e63994 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:32.364530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 519/1019] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:32.371587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:32.477417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fc69a-3b64-4d2a-8e5c-8b1ea270563a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:32.510936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5c44e-b14c-4deb-84ca-65c150a264a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:32.511597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c44e-b14c-4deb-84ca-65c150a264a7 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:32.511886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c44e-b14c-4deb-84ca-65c150a264a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:32.512177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c44e-b14c-4deb-84ca-65c150a264a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:32.512903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5c44e-b14c-4deb-84ca-65c150a264a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:32.514313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5c44e-b14c-4deb-84ca-65c150a264a7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:32.540518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 501/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:32 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:33.086709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57c770-cd2e-459d-a51a-ae9a857e08cd None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.086965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57c770-cd2e-459d-a51a-ae9a857e08cd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.087466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57c770-cd2e-459d-a51a-ae9a857e08cd None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.089093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 520/1021] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:33.094220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.094518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.094796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.112757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:33.113942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:33.124332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:33.187697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 502/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:33.210259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57c770-cd2e-459d-a51a-ae9a857e08cd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.214748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:33.324257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57c770-cd2e-459d-a51a-ae9a857e08cd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:33.358937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:33.359655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.359964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.360224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] PATH_INFO: `/v3/services/image` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.360902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:33.362273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:33.374817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:33.375793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:33.381994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 521/1023] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:33.387026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.492307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c172c53-b846-49fc-9459-98d3ee1b200f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:33.526918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:33.527616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.527930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.528211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.528928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:33.529237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:33.530645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df310708-18d5-433f-89e0-a7675aff0f20 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:33.536583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 503/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:33.542498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.615744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:33.616659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aceee2-5a2e-4a95-b4d1-75c55f29858c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.616945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aceee2-5a2e-4a95-b4d1-75c55f29858c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.617319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aceee2-5a2e-4a95-b4d1-75c55f29858c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.618834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 504/1025] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:33.623806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080fb49-c251-4968-aed3-e22214335608 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.624123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080fb49-c251-4968-aed3-e22214335608 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.624399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080fb49-c251-4968-aed3-e22214335608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.642424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1080fb49-c251-4968-aed3-e22214335608 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:33.643619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1080fb49-c251-4968-aed3-e22214335608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:33.645825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:33.652108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3e29-cb26-44da-80dd-cf728751a08c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:33.687892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:33.688586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.688860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.689146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.689889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:33.690251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:33.691747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:33.697801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 522/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:33.703624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.727279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 505/1027] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:33.750501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080fb49-c251-4968-aed3-e22214335608 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.816078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b12de-d4b5-4e96-bc70-a654613cb7e7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:33.846806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:33.852497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080fb49-c251-4968-aed3-e22214335608 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:33.853751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:33.854415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.854698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.855673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.855797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] RBAC: Adding query filter params (interface=public, service_id=318c8ced4fb040ae81e11adf6207308d, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:33.856087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:33.857457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:33.862754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 523/1028] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/endpoints?service_id=318c8ced4fb040ae81e11adf6207308d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:33.868113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.894948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:33.895778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:33.896086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:33.896360 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:33.903384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:33.907072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:33.916300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:33.917428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:33.918362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:33.921530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 506/1029] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:33.927021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:33.973271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b5299-b404-4aae-a6ad-716b387fe415 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.009720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.010390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.010674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.010951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.011639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.013148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.019802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 524/1030] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 06:58:34.028018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25fde7-fe6c-406d-90f0-3487d3957c51 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.065461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.066152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.066431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.066700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.067463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:34.067764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.069325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.079515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 507/1031] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:58:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:34.085235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.152682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:34.199277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6bdc8-b596-4d7a-b1e0-4f8235ece0c9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.234498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.235291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.235568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.235823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.246836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.248303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:34.265683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:34.266585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:34.267466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:34.267466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:34.267466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:34.267466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:34.267466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 525/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:34.272968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.337551 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:34.386801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335ec4-a0d4-4727-8c1f-1d420124c233 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.421801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.422382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.422657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.422922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.423649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:34.423984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.425345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218518a-1c76-4d50-b9c9-8d7b75299ac1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.437924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 508/1033] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:34.443373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.547761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928851c-4589-4a8a-bfeb-542555541744 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.560928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:34.583100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.583913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.584268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.584543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.592220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.593663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:34.608006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:34.608933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:34.609885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 526/1034] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:34.615227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6066-85f0-48b9-8c81-aa1d02f11e90 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.615544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6066-85f0-48b9-8c81-aa1d02f11e90 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.615820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6066-85f0-48b9-8c81-aa1d02f11e90 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.616479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.617251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 509/1035] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:34.622089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.622370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.622643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.642709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:34.644558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:34.723933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801022b-99a4-4483-b7f1-6e33a13e8a2a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.726146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 510/1036] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:34.751364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.761119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.761816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.762095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.762352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.763229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:34.763532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.764991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.788694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 527/1037] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:34.789913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.810522 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:34.825300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:34.859854 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce126-24f0-4e3d-b02e-8ed16cf9fdb4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.892329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.893126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.893394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.893668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:34.894824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:34.896291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:34.898114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 511/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:34.899457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10a597-4e27-44fc-9f16-92096c03b01a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:34.903442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:34.936592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:34.937408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:34.937686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:34.937957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.003487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f94362-dddb-4257-b2f4-f33ef243c6dc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:35.007365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.008907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.021944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:35.040117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:35.041089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:35.041749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:35.042027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:35.042310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.043193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.044630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.065226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 512/1039] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:58:34 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:58:35.120041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 528/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:35.125598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:35.235901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd50da-a0b5-4faf-a660-ccd37dcab371 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:35.270520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:35.271250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:35.271525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:35.271790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.283132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.284583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:35.301870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:35.302968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:35.304030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:35.304030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:35.304030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:35.304030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:35.304030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 513/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:35.308768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:35.419150 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2555c-9e48-4b33-ba51-a9b1f17e5c50 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:35.450687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:35.456652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:35.457347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:35.457629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:35.457907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.458633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:35.458943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.460402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.472693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 529/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:35.478554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:35.507389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:35.585308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064acf62-6923-413d-8e5c-30aa8336e57e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:35.620201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:35.621015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:35.621298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:35.621568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.628501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.629943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:35.644270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:35.645199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:35.646119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:35.648172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 514/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:35.651294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:35.757414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887065f-2763-490f-8b57-1ec95bcd6271 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:35.792890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:35.793559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:35.793837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:35.794110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.794902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:35.795213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.796798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2446af-e811-42b7-97c4-f7863ce751ca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.814740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 530/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:35.816142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:35.906322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:35.924144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c91e5-7724-4ae1-a1e6-b70a751badfc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:35.959589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:35.960266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:35.960547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:35.960819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:35.961649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] RBAC: Adding query filter params (role.id=6eae7e2272544a9088fa415a97b76a4b, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f8f4b69c63f444d1997b3426cdf1eb00) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:35.961957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:35.963384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b56f83-3741-4447-a3b5-caecbc3ab1b8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:35.969303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 515/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:35 2022] GET /identity/v3/role_assignments?user.id=f8f4b69c63f444d1997b3426cdf1eb00&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=6eae7e2272544a9088fa415a97b76a4b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:36.055154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38cc23-5d67-47c5-9883-68adadc30762 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:36.055539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38cc23-5d67-47c5-9883-68adadc30762 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:36.055946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38cc23-5d67-47c5-9883-68adadc30762 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:36.057470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 531/1046] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:36.063436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:36.063772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:36.064054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:36.082637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:36.083820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:36.158812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 516/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:36.181816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38cc23-5d67-47c5-9883-68adadc30762 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:36.238671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:36.302348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38cc23-5d67-47c5-9883-68adadc30762 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:36.336226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:36.337008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:36.337290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:36.337557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] PATH_INFO: `/v3/services/image` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:36.338201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:36.339561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:36.351220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:36.352416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 06:58:36.353623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:36.355025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 532/1048] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Jun 24 06:58:36 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:36.358641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:36.445904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:36.466192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45691-3d11-44a8-916f-dd0c02b75162 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:36.501869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:36.502534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:36.502817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:36.503090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:36.503797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:36.504128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:36.505493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:36.514997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 517/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:36.516227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:36.621812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859008a-3b59-43f4-91cc-3bc6c53fb76c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:36.636333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:36.658764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:36.659436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:36.659714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:36.660037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:36.660752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] RBAC: Adding query filter params (type=image) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:36.661054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:36.662479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7227-8249-409e-91fe-edf42b068d8e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:36.667678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 533/1050] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:36.673207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:36.777581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d813-d41a-4074-91b8-096d3ca85cfa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:36.813104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0d494-100f-44b2-9e44-819c46b906ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:36.813788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0d494-100f-44b2-9e44-819c46b906ef None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:36.814047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0d494-100f-44b2-9e44-819c46b906ef None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:36.814343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0d494-100f-44b2-9e44-819c46b906ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:36.815115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0d494-100f-44b2-9e44-819c46b906ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:36.816573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0d494-100f-44b2-9e44-819c46b906ef None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:36.831651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:36.838330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 518/1051] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 06:58:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:37.128126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b6cb-e191-4e2e-85f2-a480ef603865 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.128496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b6cb-e191-4e2e-85f2-a480ef603865 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.128721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b6cb-e191-4e2e-85f2-a480ef603865 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.130167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 534/1052] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:37.135545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.135809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.136119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.153301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:37.154469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:37.231071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 519/1053] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:37.254016 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b6cb-e191-4e2e-85f2-a480ef603865 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:37.359291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b6cb-e191-4e2e-85f2-a480ef603865 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:37.401420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:37.402142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.402419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.402688 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.413942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:37.421891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:37.422823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:37.423657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:37.428260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 535/1054] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:37.429082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:37.531711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e71556-9f96-4491-953c-8204589ffc32 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:37.559054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:37.569302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:37.569979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.570253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.570520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.571262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:37.571562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:37.572973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:37.581764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 520/1055] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:37.587407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:37.629503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:37.692178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31edb-e3fb-4614-bc28-57522820b0f4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:37.725467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6ae5-0878-4945-b98d-83cdfade2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:37.726349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6ae5-0878-4945-b98d-83cdfade2c89 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.726626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6ae5-0878-4945-b98d-83cdfade2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.726895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6ae5-0878-4945-b98d-83cdfade2c89 None admin] PATH_INFO: `/v3/users/ca36ac6641784b79aa06e8f8afed77e0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.742035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6ae5-0878-4945-b98d-83cdfade2c89 None admin] RBAC: Authorizing `identity:get_user(user_id=ca36ac6641784b79aa06e8f8afed77e0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:37.743476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6ae5-0878-4945-b98d-83cdfade2c89 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:37.745342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 536/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:37 2022] GET /identity/v3/users/ca36ac6641784b79aa06e8f8afed77e0 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:37.751131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:37.855108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c50d-05c3-4cb1-8538-5222321c74ca None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:37.890491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:37.891188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.891464 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.891737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.952725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:37.971238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:37.972900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:37.975286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc791b6-1f8a-426a-91b1-f2ec9ce5f3ad None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.975570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc791b6-1f8a-426a-91b1-f2ec9ce5f3ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.975868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc791b6-1f8a-426a-91b1-f2ec9ce5f3ad None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:37.977405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 537/1057] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:37.982991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:37.983280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:37.983559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.000370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:38.001567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:38.077809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 538/1058] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:38.095031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 521/1059] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:38.096508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.101146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.126116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:38.194613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:38.205101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0be1-a8ae-48ec-84e1-acd95d294f59 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.209535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b5359-58e4-42b4-a0d9-2bf8d4ca9178 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.246005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.246188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.246895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.247177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.247454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.247646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.248081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.248479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.249779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] RBAC: Authorizing `identity:get_project(project_id=945183ec62ac41b2a9a6e13f0d502d3c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:38.251343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:38.253220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 539/1060] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:38.259472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.262401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:38.270784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:38.271758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:38.275604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 522/1061] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:38.278085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.364252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:38.375448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb91b-2174-47fd-96d1-ff70e1324dec None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.383721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd1a7-2209-4570-acef-6f74fd5d4d19 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.416615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.417280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.417570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.417842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.418686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c, user.id=ca36ac6641784b79aa06e8f8afed77e0) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:38.419001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:38.420598 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:38.424023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.425176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.425675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.426142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.426246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 540/1062] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/role_assignments?user.id=ca36ac6641784b79aa06e8f8afed77e0&scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:38.427183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:38.427685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:38.429304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:38.442285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 523/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:38.448381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.560458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76477d8-0f4f-4438-820c-5332211419df None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.600320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.601128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.601411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.601684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.612413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:38.613868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:38.631764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:38.632759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:38.633631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:38.633631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:38.633631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:38.633631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:38.633631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 541/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:38.638853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.651937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:38.743415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe78a-6b72-403a-8f12-5cdc34297f4f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.778846 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.779516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.779797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.780090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.780825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:38.781129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:38.782530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6104f0c-ef25-43d6-9c01-c7c49e69d7db None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:38.795289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 524/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:38.801548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.813811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:38.883943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605c4f-1def-44cb-adbd-c7aca80497b0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.884221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605c4f-1def-44cb-adbd-c7aca80497b0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.884490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605c4f-1def-44cb-adbd-c7aca80497b0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.886130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 525/1066] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:38.890909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.891195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.891459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.907522 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251da8b9-3efe-401e-844c-6c03d3cb9ee7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:38.908345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:38.909652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:38.945894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:38.946691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:38.946976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:38.947279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:38.955341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:38.956816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:38.972141 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:38.973123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:38.974045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 542/1067] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:38.979429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:38.982202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:38.988361 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 526/1068] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:58:39.010330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.057355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.088890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d525f-2338-444b-a4e7-1e4d88f986a0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.113364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67226f6-7165-4662-be33-df9dc8644600 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.125808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.126524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.126811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.127085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.128142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:39.128514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.130433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.151890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.152557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.152843 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.153122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.155571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 543/1069] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:58:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:39.156603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.222036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.225783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.227684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.264008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb8067-bb38-4da2-a192-8250bf721d4b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.296220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.306359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.307175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.307452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.307724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.320984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.322555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.337132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 527/1070] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:39.340929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:39.341800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:39.342704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:39.342704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:39.342704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:39.342704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:39.342704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 544/1071] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:39.343245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.348826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.450472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.453713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4077-ac72-4f41-8b06-c6acc64a8719 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.457748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023cb29-eb51-4d8d-a876-e0cfa9f898c6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.491374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.492204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.492482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.492747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.493349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.494015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.494295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.494569 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.495293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:39.495602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.497011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.503141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.504616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.514421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 545/1072] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:39.515512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:39.522630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:39.523793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:39.524768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:39.524768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:39.524768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:39.524768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:39.524768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 528/1073] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:39.529992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.563624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.625108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9c524-7a59-43aa-8028-9575af161b99 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.639341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8532ce-3716-4f31-9d15-c17d444474d3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.666763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.667593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.667879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.668155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.675138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.676684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.681092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.681835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.682185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.682531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.683324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:39.683714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.685177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:39.691264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:39.692149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:39.693049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 546/1074] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:39.698220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.699658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 529/1075] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:39.803967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.808304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d47a9-fad8-4281-bb5c-9754f32365cf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:39.845539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:39.846216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:39.846498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:39.846772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:39.847568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:39.847901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:39.849342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd84239-f1ff-4ccf-84c1-4fd58d4710f1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:39.862306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 547/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:39.870006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:39.886028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:39.983074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f3b4-99b2-489f-9c75-cfb03cc1bc9d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:40.016210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228018-1bd8-4bae-baf8-6b6f1f84d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:40.017141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228018-1bd8-4bae-baf8-6b6f1f84d929 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:40.017387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228018-1bd8-4bae-baf8-6b6f1f84d929 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:40.017661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228018-1bd8-4bae-baf8-6b6f1f84d929 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f8f4b69c63f444d1997b3426cdf1eb00/roles/6eae7e2272544a9088fa415a97b76a4b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:40.019811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228018-1bd8-4bae-baf8-6b6f1f84d929 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=f8f4b69c63f444d1997b3426cdf1eb00, role_id=6eae7e2272544a9088fa415a97b76a4b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:40.021310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228018-1bd8-4bae-baf8-6b6f1f84d929 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:40.034546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 530/1077] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:39 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/f8f4b69c63f444d1997b3426cdf1eb00/roles/6eae7e2272544a9088fa415a97b76a4b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 06:58:40.466878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c171d-740a-4e5c-a011-d0f06bf45714 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:40.467414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c171d-740a-4e5c-a011-d0f06bf45714 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:40.467529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c171d-740a-4e5c-a011-d0f06bf45714 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:40.468993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 548/1078] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:40.474735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:40.475362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:40.475641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:40.493262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:40.494433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:40.563093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 531/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:40.585806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c171d-740a-4e5c-a011-d0f06bf45714 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:40.690670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c171d-740a-4e5c-a011-d0f06bf45714 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:40.728448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:40.729247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:40.729530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:40.729807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:40.741111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:40.749232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:40.750277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:40.756259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 549/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:40.756947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:40.758851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:40.861288 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3666bc-6072-4947-ab76-c155e20685cb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:40.897224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:40.897887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:40.898165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:40.898438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:40.899188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:40.899498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:40.900920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:40.909216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 532/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:40.915187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:40.937539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:41.019552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf29f2-9b40-4423-a1f1-965c7ab2b467 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:41.054861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:41.055741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:41.056093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:41.056366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] PATH_INFO: `/v3/users/ca36ac6641784b79aa06e8f8afed77e0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:41.057565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] RBAC: Authorizing `identity:get_user(user_id=ca36ac6641784b79aa06e8f8afed77e0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:41.059007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:41.060887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 550/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:40 2022] GET /identity/v3/users/ca36ac6641784b79aa06e8f8afed77e0 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:41.066541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:41.137453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:41.176283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbefc-6309-49c4-9ad8-aa713b70b173 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:41.210625 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46415494-3e1c-4659-9a0e-b15794b1fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:41.211483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415494-3e1c-4659-9a0e-b15794b1fe48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:41.211758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415494-3e1c-4659-9a0e-b15794b1fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:41.212058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415494-3e1c-4659-9a0e-b15794b1fe48 None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:41.213283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46415494-3e1c-4659-9a0e-b15794b1fe48 None admin] RBAC: Authorizing `identity:get_project(project_id=945183ec62ac41b2a9a6e13f0d502d3c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:41.214730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46415494-3e1c-4659-9a0e-b15794b1fe48 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:41.216451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 533/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:58:41 2022] GET /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:41.222454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:41.316779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:41.330187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eda87d-3934-4fe4-8dd4-5aa413b20c7d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:41.364385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6674-b3c4-41c6-ba4a-859206a289f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:41.365279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6674-b3c4-41c6-ba4a-859206a289f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:41.365559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6674-b3c4-41c6-ba4a-859206a289f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:41.365833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6674-b3c4-41c6-ba4a-859206a289f9 None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c/users/ca36ac6641784b79aa06e8f8afed77e0/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:41.367898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6674-b3c4-41c6-ba4a-859206a289f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=945183ec62ac41b2a9a6e13f0d502d3c, user_id=ca36ac6641784b79aa06e8f8afed77e0, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:41.369341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6674-b3c4-41c6-ba4a-859206a289f9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:41.384928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 551/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:41 2022] PUT /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c/users/ca36ac6641784b79aa06e8f8afed77e0/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:58:42.005355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33e89-ce82-4a71-8fee-6707da4f67bf None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.006010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33e89-ce82-4a71-8fee-6707da4f67bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.006114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33e89-ce82-4a71-8fee-6707da4f67bf None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.007442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 534/1085] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:42.012818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.013196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.013367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.030515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:42.031953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:42.099831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 552/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:42.123288 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33e89-ce82-4a71-8fee-6707da4f67bf None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:42.228331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33e89-ce82-4a71-8fee-6707da4f67bf None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:42.258203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:42.264015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:42.264806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.265078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.265342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.275765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:42.284054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:42.285115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 06:58:42.286150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:42.288019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 535/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jun 24 06:58:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:42.291145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:42.371301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:42.395272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e042fb-ecc3-4a8e-a665-26df85501be8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:42.431353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:42.432048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.432326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.432602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.433348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:42.433683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:42.435054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:42.443157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 553/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:58:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:42.449121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:42.557745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d8f59-37ce-4af5-9857-1ac26713b5f2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:42.592289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:42.593078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.593358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.593632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.604115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:42.605558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:42.622865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:42.623865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:42.624772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:42.624772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:42.624772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:42.624772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:42.624772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 536/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:42.629963 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:42.732082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e55e-777f-4fe0-96fb-d1330808b90f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:42.766392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:42.767047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.767325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.767600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.768357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:42.768666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:42.770031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:42.778891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:42.782330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 554/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:42.788198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:42.842920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:42.899016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefed6cc-c018-4a47-a176-f89b60ff6d11 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:42.933883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:42.934688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:42.934965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:42.935236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:42.943107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:42.944697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 06:58:42.958589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:42.959538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:42.960521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 537/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jun 24 06:58:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:42.965667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.066738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67d9d-a7d5-40f2-af2b-0c7f284195e6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.100914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.101538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.101899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.102176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.103364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:43.103676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.105146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a16f05-6b34-4cc7-9113-773867dd91a1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.122401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 555/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jun 24 06:58:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:43.128307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.230973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96938-e253-4e5d-8bec-539669ce21ea None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.233472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.269974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.270631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.270911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.271182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.338988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.340463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.376075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b8ff7-9454-4e5b-be93-a533b303d235 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.376341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b8ff7-9454-4e5b-be93-a533b303d235 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.376621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b8ff7-9454-4e5b-be93-a533b303d235 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.378013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 556/1093] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 06:58:43.383208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.383467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.383765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.402384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:43.403586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:43.441614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 538/1094] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:43.447510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.451277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.460275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.475260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 557/1095] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:43.498908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.546590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e63e91-0c80-486e-9e55-28b43db4e3e5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.579712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.580541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.580823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.581097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.591143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.592640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.598078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b1819-876f-4715-8ae1-8499ba32427d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:58:43.610611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:43.611508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:43.612888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 06:58:43.612888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:58:43.612888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 06:58:43.612888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:43.612888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 539/1096] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:43.617527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.631927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.632671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.632946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.633216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.643218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:58:43.650932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:43.652082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:58:43.653071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 558/1097] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:58:43.658156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.673012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.706036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.717000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d561f-a874-4fc2-b51d-abec71aecb4d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.751680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.752371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.752653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.752959 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.753687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:43.753993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.755368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.757775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61820-4b17-4d22-afbf-f606dab7a8a7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.766702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 540/1098] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:43.772312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.792217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.792899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.793180 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.793458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.794206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:43.794515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.795916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.804088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 559/1099] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:43.809618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.870442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b7a8-1a63-493d-b61a-ef6d0baacac4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.886548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.904613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.904869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ba269-4cc4-455d-8f61-378a0edc9782 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:43.905543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.905884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.906235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.912825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.914260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.915609 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 06:58:43.930586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:58:43.931618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 541/1100] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 06:58:43.937542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:43.941807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:43.942695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:43.942970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:43.943237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] PATH_INFO: `/v3/users/ca36ac6641784b79aa06e8f8afed77e0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:43.944555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] RBAC: Authorizing `identity:get_user(user_id=ca36ac6641784b79aa06e8f8afed77e0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:43.945997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:43.952158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 560/1101] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/users/ca36ac6641784b79aa06e8f8afed77e0 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:43.953119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:44.035499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977c7f-2a19-4056-8cc5-01c18f55c049 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:44.053073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28383a-66fe-4527-8531-baa58186d13a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:44.069165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:44.069819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:44.070100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:44.070375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:44.071166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:44.071476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:44.072961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:44.084919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 542/1102] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:44.088187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:44.088838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:44.089116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:44.089385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:44.090647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:44.126489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:44.138783 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:44.161004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:44.162511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:44.192180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4c95a-89da-40ce-aa83-172012c9eaf6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:44.226054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:44.226775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:44.227075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:44.227364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:44.228559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] RBAC: Adding query filter params (role.id=6eae7e2272544a9088fa415a97b76a4b, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=f8f4b69c63f444d1997b3426cdf1eb00) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:44.228863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:44.230286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:44.236218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 543/1103] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:44 2022] GET /identity/v3/role_assignments?user.id=f8f4b69c63f444d1997b3426cdf1eb00&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=6eae7e2272544a9088fa415a97b76a4b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 06:58:44.265404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 561/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:44.271572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:44.378358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:44.381642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52377-a018-45f5-9367-3f3c394ed914 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:44.417722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3fb9a-dbd7-47fc-8e56-13d93337ca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:44.418508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3fb9a-dbd7-47fc-8e56-13d93337ca44 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:44.418784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3fb9a-dbd7-47fc-8e56-13d93337ca44 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:44.419053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3fb9a-dbd7-47fc-8e56-13d93337ca44 None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:44.420259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3fb9a-dbd7-47fc-8e56-13d93337ca44 None admin] RBAC: Authorizing `identity:get_project(project_id=945183ec62ac41b2a9a6e13f0d502d3c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:44.421714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3fb9a-dbd7-47fc-8e56-13d93337ca44 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:44.423416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 544/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:58:44 2022] GET /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:44.429789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:44.510252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:44.533701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ba7d-4ed6-4570-b625-b9bdddea911b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:44.568968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:44.569632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:44.569911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:44.570178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:44.571014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c, user.id=ca36ac6641784b79aa06e8f8afed77e0) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:44.571325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:44.572829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28a090-271c-4eb8-bbe2-deae406ff670 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:44.578817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 562/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:44 2022] GET /identity/v3/role_assignments?user.id=ca36ac6641784b79aa06e8f8afed77e0&scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:46.597713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd0750-e3ad-42f4-81c7-18bf3bf31b93 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:46.598591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd0750-e3ad-42f4-81c7-18bf3bf31b93 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:46.598591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd0750-e3ad-42f4-81c7-18bf3bf31b93 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:46.600497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 545/1107] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:46.606274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:46.606734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:46.606826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:46.623939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:46.625043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:46.692546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 563/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:46.717485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd0750-e3ad-42f4-81c7-18bf3bf31b93 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:46.822149 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd0750-e3ad-42f4-81c7-18bf3bf31b93 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:46.858515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2561b81-095e-4391-8b1b-5cc1cfdb02b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:46.859727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561b81-095e-4391-8b1b-5cc1cfdb02b8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:46.860037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561b81-095e-4391-8b1b-5cc1cfdb02b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:46.860314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561b81-095e-4391-8b1b-5cc1cfdb02b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:46.862981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2561b81-095e-4391-8b1b-5cc1cfdb02b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:46.864458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2561b81-095e-4391-8b1b-5cc1cfdb02b8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:46.866199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 546/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:46.875559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:46.953363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:46.985885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2366-5bc1-41c1-a488-f144d4588b01 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:47.020803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412353b4-8d3a-42da-9a8e-e176beac371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:47.021497 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412353b4-8d3a-42da-9a8e-e176beac371c None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:47.021774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412353b4-8d3a-42da-9a8e-e176beac371c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:47.022042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412353b4-8d3a-42da-9a8e-e176beac371c None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:47.022740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412353b4-8d3a-42da-9a8e-e176beac371c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:47.024184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412353b4-8d3a-42da-9a8e-e176beac371c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:47.048142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 564/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:58:46 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:58:49.106492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2506-a575-4c68-9d4d-f74f313a9e1c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:49.107345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2506-a575-4c68-9d4d-f74f313a9e1c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:49.107345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2506-a575-4c68-9d4d-f74f313a9e1c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:49.109748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 547/1111] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:49.116140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:49.116597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:49.116714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:49.144529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:49.146445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:49.221495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 565/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:49.250577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e2506-a575-4c68-9d4d-f74f313a9e1c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:49.298859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:49.388612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e2506-a575-4c68-9d4d-f74f313a9e1c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:49.427495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:49.428392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:49.428666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:49.428938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] PATH_INFO: `/v3/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:49.430493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] RBAC: Authorizing `identity:get_role(role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:49.431876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:49.433261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 548/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:49 2022] GET /identity/v3/roles/90387e9afaca4d41b37d78e341b4e561 => generated 223 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:49.439531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:49.510063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:49.553046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe7459-0d48-4a16-9b6b-c3ba1ab606d8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:49.588835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:49.589709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:49.589983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:49.590258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] PATH_INFO: `/v3/users/56187dcb6f3b48adb4c5845483df610a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:49.604076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] RBAC: Authorizing `identity:get_user(user_id=56187dcb6f3b48adb4c5845483df610a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:49.605526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:49.607192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 566/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:49 2022] GET /identity/v3/users/56187dcb6f3b48adb4c5845483df610a => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:49.616694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:49.728838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450fc03-b36a-4408-9e47-b09515d2797c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:49.731253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:49.768541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:49.769153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:49.769460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:49.769733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:49.837707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:49.839140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:49.939618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 549/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:49.949111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:50.060610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca815-ecf7-4dcb-a7bd-f1c7180721c4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:50.077070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:50.096003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b797a2-1929-4caf-8449-861b07c1b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:50.096859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b797a2-1929-4caf-8449-861b07c1b43d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:50.097140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b797a2-1929-4caf-8449-861b07c1b43d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:50.097415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b797a2-1929-4caf-8449-861b07c1b43d None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:50.098642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b797a2-1929-4caf-8449-861b07c1b43d None admin] RBAC: Authorizing `identity:get_project(project_id=945183ec62ac41b2a9a6e13f0d502d3c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:50.100129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b797a2-1929-4caf-8449-861b07c1b43d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:50.101816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 567/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:58:49 2022] GET /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:50.108331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:50.111530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:50.208668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d200a67-0aa9-44b0-9dc7-868d2a5b5423 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:50.244069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:50.244711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:50.244993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:50.245263 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:50.246089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] RBAC: Adding query filter params (role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c, user.id=56187dcb6f3b48adb4c5845483df610a) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:50.246401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:50.247822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f45fc2-fa61-40d4-a658-1fd080790a22 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:50.253430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 550/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:50 2022] GET /identity/v3/role_assignments?user.id=56187dcb6f3b48adb4c5845483df610a&scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:52.213647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f816ac-44f0-47a5-8b3a-163fe403fcbb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:52.214197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f816ac-44f0-47a5-8b3a-163fe403fcbb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:52.214197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f816ac-44f0-47a5-8b3a-163fe403fcbb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:52.216352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 568/1118] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:52.225124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:52.225526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:52.225732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:52.248815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:52.249992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:52.311724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:52.318473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 551/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:52.341927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f816ac-44f0-47a5-8b3a-163fe403fcbb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:52.460006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f816ac-44f0-47a5-8b3a-163fe403fcbb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:52.495924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:52.496725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:52.497007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:52.497283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] PATH_INFO: `/v3/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:52.498918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] RBAC: Authorizing `identity:get_role(role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:52.500340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:52.501803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 569/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:52 2022] GET /identity/v3/roles/90387e9afaca4d41b37d78e341b4e561 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:52.508394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:52.609896 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e0c9-742d-41b6-8330-fce67a15bf2a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:52.655479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:52.656892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:52.657302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:52.657810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] PATH_INFO: `/v3/users/56187dcb6f3b48adb4c5845483df610a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:52.659892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] RBAC: Authorizing `identity:get_user(user_id=56187dcb6f3b48adb4c5845483df610a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:52.662283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:52.663933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 552/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:52 2022] GET /identity/v3/users/56187dcb6f3b48adb4c5845483df610a => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:52.670002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:52.724656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:52.779645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f956cb-ead1-4995-b7fa-6e308d4dfb66 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:52.814862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea61a34-0e51-484a-a5fd-0833806fd40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:52.815704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61a34-0e51-484a-a5fd-0833806fd40c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:52.816005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61a34-0e51-484a-a5fd-0833806fd40c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:52.816270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61a34-0e51-484a-a5fd-0833806fd40c None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:52.817551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea61a34-0e51-484a-a5fd-0833806fd40c None admin] RBAC: Authorizing `identity:get_project(project_id=945183ec62ac41b2a9a6e13f0d502d3c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:52.819008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea61a34-0e51-484a-a5fd-0833806fd40c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:52.820697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 570/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:58:52 2022] GET /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:52.827172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:52.895315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:52.946196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5106ee-93fc-4cb7-b729-890d32894f19 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:52.982790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7472c-cd81-4a0b-b774-3993bc893287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:52.983670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7472c-cd81-4a0b-b774-3993bc893287 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:52.983976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7472c-cd81-4a0b-b774-3993bc893287 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:52.984245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7472c-cd81-4a0b-b774-3993bc893287 None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c/users/56187dcb6f3b48adb4c5845483df610a/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:52.986809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7472c-cd81-4a0b-b774-3993bc893287 None admin] RBAC: Authorizing `identity:create_grant(project_id=945183ec62ac41b2a9a6e13f0d502d3c, user_id=56187dcb6f3b48adb4c5845483df610a, role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:52.988267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7472c-cd81-4a0b-b774-3993bc893287 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:53.004907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 553/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:58:52 2022] PUT /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c/users/56187dcb6f3b48adb4c5845483df610a/roles/90387e9afaca4d41b37d78e341b4e561 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:58:54.972585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3489789-7b8e-4d51-9e01-4e02e56c6f6e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:54.973485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3489789-7b8e-4d51-9e01-4e02e56c6f6e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:54.973485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3489789-7b8e-4d51-9e01-4e02e56c6f6e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:54.975350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 571/1124] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:54.981238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:54.981693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:54.981789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:55.000263 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:55.001425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:55.076962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 554/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:55.101472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3489789-7b8e-4d51-9e01-4e02e56c6f6e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:55.212940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3489789-7b8e-4d51-9e01-4e02e56c6f6e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:55.233541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:55.248218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:55.249045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:55.249323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:55.249596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] PATH_INFO: `/v3/roles/90387e9afaca4d41b37d78e341b4e561` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:55.251078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] RBAC: Authorizing `identity:get_role(role_id=90387e9afaca4d41b37d78e341b4e561)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:55.252488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:55.253853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 572/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:55 2022] GET /identity/v3/roles/90387e9afaca4d41b37d78e341b4e561 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:55.260277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:55.319472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:55.377989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a7198-0519-43e6-a36f-a2a55f08d3c7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:55.414631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:55.415507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:55.415788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:55.416112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] PATH_INFO: `/v3/users/56187dcb6f3b48adb4c5845483df610a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:55.417380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] RBAC: Authorizing `identity:get_user(user_id=56187dcb6f3b48adb4c5845483df610a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:55.418818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:55.420504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 555/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:58:55 2022] GET /identity/v3/users/56187dcb6f3b48adb4c5845483df610a => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:55.429640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:55.536664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152906-f856-4570-9104-01dfdfaa02a2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:55.575812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:55.576473 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:55.576750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:55.577019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:55.636601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:55.659792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:55.662267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:55.764801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 573/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:58:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:58:55.773336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:55.876918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4f584-3fdc-4c77-ab15-94060ac582e9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:55.900602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:55.913856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e024-cebe-4445-978e-dd6eaf71209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:55.914746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e024-cebe-4445-978e-dd6eaf71209c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:55.915026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e024-cebe-4445-978e-dd6eaf71209c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:55.915298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e024-cebe-4445-978e-dd6eaf71209c None admin] PATH_INFO: `/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:55.916527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308e024-cebe-4445-978e-dd6eaf71209c None admin] RBAC: Authorizing `identity:get_project(project_id=945183ec62ac41b2a9a6e13f0d502d3c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:55.917973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308e024-cebe-4445-978e-dd6eaf71209c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:55.919697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 556/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:58:55 2022] GET /identity/v3/projects/945183ec62ac41b2a9a6e13f0d502d3c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:55.925968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:56.021215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:56.035605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e591407-6722-4b3f-88f0-fc775f15ae0d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:56.072999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:56.073638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:56.073924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:56.074198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:56.075030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] RBAC: Adding query filter params (role.id=90387e9afaca4d41b37d78e341b4e561, scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c, user.id=56187dcb6f3b48adb4c5845483df610a) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:58:56.075342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:56.076804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d22fc4-8b1a-45f3-87fe-078e1c68ccdf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:56.083318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 574/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:58:55 2022] GET /identity/v3/role_assignments?user.id=56187dcb6f3b48adb4c5845483df610a&scope.project.id=945183ec62ac41b2a9a6e13f0d502d3c&role.id=90387e9afaca4d41b37d78e341b4e561 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:58.109807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2be25-fd25-4168-a634-1f022ae4a75c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:58.110366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2be25-fd25-4168-a634-1f022ae4a75c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:58.110366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2be25-fd25-4168-a634-1f022ae4a75c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:58.111709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 557/1131] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:58:58.118033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:58.118784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:58.118926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:58.147163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:58:58.148365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:58:58.217708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 575/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:58:58.241410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2be25-fd25-4168-a634-1f022ae4a75c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:58.350473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2be25-fd25-4168-a634-1f022ae4a75c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:58.389613 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b7e4e-34ba-4328-9d89-b91ca2a0892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:58.390411 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7e4e-34ba-4328-9d89-b91ca2a0892c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:58.390690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7e4e-34ba-4328-9d89-b91ca2a0892c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:58.390962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7e4e-34ba-4328-9d89-b91ca2a0892c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:58.392227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b7e4e-34ba-4328-9d89-b91ca2a0892c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:58.393659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b7e4e-34ba-4328-9d89-b91ca2a0892c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:58.395239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 558/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:58:58.401326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:58:58.493636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:58:58.516497 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68921e6-e302-4552-9065-0518e12945a8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:58:58.559064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7b03-195d-42c3-b2ed-e241bc002a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:58:58.559717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7b03-195d-42c3-b2ed-e241bc002a8d None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:58:58.560037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7b03-195d-42c3-b2ed-e241bc002a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:58:58.560311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7b03-195d-42c3-b2ed-e241bc002a8d None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:58:58.561017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7b03-195d-42c3-b2ed-e241bc002a8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:58:58.562445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7b03-195d-42c3-b2ed-e241bc002a8d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:58:58.596980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 576/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:58:58 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:59:00.607533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526ea51-23c3-4c90-ac9e-c0f8203d1542 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:00.608439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526ea51-23c3-4c90-ac9e-c0f8203d1542 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:00.608439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526ea51-23c3-4c90-ac9e-c0f8203d1542 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:00.610694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 559/1135] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:00.617108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:00.617539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:00.617684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:00.640148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:00.641279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:00.718748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 577/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:00.745178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526ea51-23c3-4c90-ac9e-c0f8203d1542 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:00.818423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:00.872768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526ea51-23c3-4c90-ac9e-c0f8203d1542 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:00.907177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aa161-f9b6-4193-b991-311ddbd2224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:00.907897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa161-f9b6-4193-b991-311ddbd2224f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:00.908187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa161-f9b6-4193-b991-311ddbd2224f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:00.908459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa161-f9b6-4193-b991-311ddbd2224f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:00.909637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aa161-f9b6-4193-b991-311ddbd2224f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:00.911133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aa161-f9b6-4193-b991-311ddbd2224f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:00.912844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 560/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 06:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:00.921603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:00.992200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:01.035417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2da7-69a1-42ae-82ec-c699dd83c67c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:01.071990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b8833-c358-4834-bf94-339b6a00af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:01.072651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b8833-c358-4834-bf94-339b6a00af10 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:01.072925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b8833-c358-4834-bf94-339b6a00af10 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:01.073195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b8833-c358-4834-bf94-339b6a00af10 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:01.073908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b8833-c358-4834-bf94-339b6a00af10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:01.075334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b8833-c358-4834-bf94-339b6a00af10 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:01.096734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 578/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:59:00 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:59:03.152561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd77f-3d17-4fe9-91cb-3283919eea8a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:03.153120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd77f-3d17-4fe9-91cb-3283919eea8a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:03.153120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd77f-3d17-4fe9-91cb-3283919eea8a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:03.154483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 561/1139] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:03.160853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:03.161542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:03.161717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:03.180025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:03.181194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:03.250912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 579/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:03.283087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd77f-3d17-4fe9-91cb-3283919eea8a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:03.390519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd77f-3d17-4fe9-91cb-3283919eea8a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:03.417982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:03.428123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:03.428923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:03.429202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:03.429457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:03.439762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:59:03.447504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:03.448707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:59:03.449942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 562/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:03.454975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:03.509663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:03.563045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7dc9-e2df-4bac-ad1d-5f7f0097ae1c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:03.597571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:03.598225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:03.598507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:03.598773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:03.599544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:03.599882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:03.601241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:03.614359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 580/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:03.620267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:03.734589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a0ab5-6346-4956-8ada-98eb1e8e86d8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:03.769572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:03.770444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:03.770723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:03.770997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] PATH_INFO: `/v3/users/e78a01406f2b42cebe69aa72886f2bd8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:03.784580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] RBAC: Authorizing `identity:get_user(user_id=e78a01406f2b42cebe69aa72886f2bd8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:03.786029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:03.787816 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 563/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:59:03 2022] GET /identity/v3/users/e78a01406f2b42cebe69aa72886f2bd8 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:03.797255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:03.930116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331b64-d2ee-476d-bbb8-c71fbd9f75cc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:03.943280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:03.966226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:03.966863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:03.967145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:03.967422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:04.051466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:04.053006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:04.153233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 581/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:59:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:59:04.162382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:04.212424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:04.270081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607ffe-c624-4dec-a115-3cf0bf4d0b58 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:04.305136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d4710-56b1-477c-bc5f-5e03b252c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:04.305919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4710-56b1-477c-bc5f-5e03b252c732 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:04.306193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4710-56b1-477c-bc5f-5e03b252c732 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:04.306460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4710-56b1-477c-bc5f-5e03b252c732 None admin] PATH_INFO: `/v3/projects/3cb81214f8224d35acb16770d12d3acd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:04.307748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d4710-56b1-477c-bc5f-5e03b252c732 None admin] RBAC: Authorizing `identity:get_project(project_id=3cb81214f8224d35acb16770d12d3acd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:04.309234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d4710-56b1-477c-bc5f-5e03b252c732 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:04.310908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 564/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:59:04 2022] GET /identity/v3/projects/3cb81214f8224d35acb16770d12d3acd => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:04.317936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:04.337908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:04.434979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bca3-b464-4b66-878e-606f9506a08a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:04.470146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:04.470801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:04.471082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:04.471359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:04.472229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=3cb81214f8224d35acb16770d12d3acd, user.id=e78a01406f2b42cebe69aa72886f2bd8) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:04.472551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:04.473998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ed0f-12c1-4a5b-bf50-7e30e601144b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:04.479858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 582/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:59:04 2022] GET /identity/v3/role_assignments?user.id=e78a01406f2b42cebe69aa72886f2bd8&scope.project.id=3cb81214f8224d35acb16770d12d3acd&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:06.448610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60d45-63d1-4259-a044-ee3259f7a94b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:06.449433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60d45-63d1-4259-a044-ee3259f7a94b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:06.449433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60d45-63d1-4259-a044-ee3259f7a94b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:06.451587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 565/1147] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:06.459634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:06.460098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:06.460214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:06.478805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:06.480001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:06.549927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 583/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:59:06.572577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60d45-63d1-4259-a044-ee3259f7a94b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:06.691901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60d45-63d1-4259-a044-ee3259f7a94b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:06.705853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:06.742797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:06.743604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:06.743891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:06.744191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:06.761081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:59:06.768939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:06.770094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:59:06.771077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 566/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:06.776778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:06.785195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:06.892554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a544-0e79-40f7-b1a3-f663ebb316c3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:06.932981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:06.933641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:06.933920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:06.934192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:06.934933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:06.935238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:06.936665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:06.944655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 584/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:06.952758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:07.068443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7abf7-5ba5-4688-b4c8-6e125e99621b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:07.107151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:07.108506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:07.108899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:07.109286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] PATH_INFO: `/v3/users/e78a01406f2b42cebe69aa72886f2bd8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:07.111341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] RBAC: Authorizing `identity:get_user(user_id=e78a01406f2b42cebe69aa72886f2bd8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:07.113681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:07.115922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 567/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:59:06 2022] GET /identity/v3/users/e78a01406f2b42cebe69aa72886f2bd8 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:07.125379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:07.205918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:07.243505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed94473-1b5b-4e4f-a8fe-f442e1aae377 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:07.280760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5f2c9-53ea-475d-be2f-2107a318dcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:07.281621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5f2c9-53ea-475d-be2f-2107a318dcab None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:07.281897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5f2c9-53ea-475d-be2f-2107a318dcab None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:07.282169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5f2c9-53ea-475d-be2f-2107a318dcab None admin] PATH_INFO: `/v3/projects/3cb81214f8224d35acb16770d12d3acd` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:07.283488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5f2c9-53ea-475d-be2f-2107a318dcab None admin] RBAC: Authorizing `identity:get_project(project_id=3cb81214f8224d35acb16770d12d3acd)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:07.284970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5f2c9-53ea-475d-be2f-2107a318dcab None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:07.286677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 585/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:59:07 2022] GET /identity/v3/projects/3cb81214f8224d35acb16770d12d3acd => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:07.293402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:07.341607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:07.404087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b4170-27f1-4bb1-9448-ea1af60486b4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:07.442330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb214-a591-4901-a3c2-5171486d06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:07.443487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb214-a591-4901-a3c2-5171486d06bf None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:07.443796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb214-a591-4901-a3c2-5171486d06bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:07.444097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb214-a591-4901-a3c2-5171486d06bf None admin] PATH_INFO: `/v3/projects/3cb81214f8224d35acb16770d12d3acd/users/e78a01406f2b42cebe69aa72886f2bd8/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:07.446679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeb214-a591-4901-a3c2-5171486d06bf None admin] RBAC: Authorizing `identity:create_grant(project_id=3cb81214f8224d35acb16770d12d3acd, user_id=e78a01406f2b42cebe69aa72886f2bd8, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:07.449463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeb214-a591-4901-a3c2-5171486d06bf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:07.467315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 568/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:59:07 2022] PUT /identity/v3/projects/3cb81214f8224d35acb16770d12d3acd/users/e78a01406f2b42cebe69aa72886f2bd8/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 06:59:09.434134 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d61a66-0a83-46b3-a1e4-eb7d57f587d5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:09.434919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d61a66-0a83-46b3-a1e4-eb7d57f587d5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:09.435109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d61a66-0a83-46b3-a1e4-eb7d57f587d5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:09.437386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 586/1154] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:09.445517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:09.445957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:09.446046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:09.464166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:09.465321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:09.536027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 569/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 06:59:09.566287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d61a66-0a83-46b3-a1e4-eb7d57f587d5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:09.676188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d61a66-0a83-46b3-a1e4-eb7d57f587d5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:09.711300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:09.712106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:09.712386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:09.712658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:09.715582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:09.724696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:59:09.732677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:09.733745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:59:09.734579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 587/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:09.740598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:09.778211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:09.851017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614280d8-6c69-43b8-82b6-0e3684c10ce3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:09.886550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:09.887209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:09.887481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:09.887748 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:09.888533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:09.888833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:09.890200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:09.898580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 570/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:09.904696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:10.009805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e57b-c260-4d15-8141-b38d0f43e650 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:10.044947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:10.045807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:10.046087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:10.046360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] PATH_INFO: `/v3/users/e78a01406f2b42cebe69aa72886f2bd8` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:10.047580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] RBAC: Authorizing `identity:get_user(user_id=e78a01406f2b42cebe69aa72886f2bd8)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:10.049044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:10.050653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 588/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:59:09 2022] GET /identity/v3/users/e78a01406f2b42cebe69aa72886f2bd8 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:10.056758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:10.164084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:10.174985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9d84-ebcb-4652-ad6b-d2ed204f6517 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:10.210709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:10.211354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:10.211633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:10.211928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:10.288313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:10.290467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:10.390228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:10.398493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 571/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:59:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:59:10.407801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:10.479101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:10.529938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9829e83-18b8-4873-b4a5-50b0f954dec1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:10.565540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c5ab-e3bc-4ce1-bfbf-17f31074fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:10.566398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c5ab-e3bc-4ce1-bfbf-17f31074fcaa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:10.566675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c5ab-e3bc-4ce1-bfbf-17f31074fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:10.566945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c5ab-e3bc-4ce1-bfbf-17f31074fcaa None admin] PATH_INFO: `/v3/projects/3cb81214f8224d35acb16770d12d3acd` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:10.568299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963c5ab-e3bc-4ce1-bfbf-17f31074fcaa None admin] RBAC: Authorizing `identity:get_project(project_id=3cb81214f8224d35acb16770d12d3acd)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:10.569737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963c5ab-e3bc-4ce1-bfbf-17f31074fcaa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:10.571457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 589/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:59:10 2022] GET /identity/v3/projects/3cb81214f8224d35acb16770d12d3acd => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:10.577813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:10.682426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce94e1-8431-417c-8c65-f17986a85525 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:10.717092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:10.717723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:10.718004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:10.718266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:10.719102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=3cb81214f8224d35acb16770d12d3acd, user.id=e78a01406f2b42cebe69aa72886f2bd8) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:10.719406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:10.720851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e4c14-6a6c-4d7f-8e86-ce9bcc9ab3a9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:10.726925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 572/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:59:10 2022] GET /identity/v3/role_assignments?user.id=e78a01406f2b42cebe69aa72886f2bd8&scope.project.id=3cb81214f8224d35acb16770d12d3acd&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:12.733820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926bf6-c5f5-4775-9437-91eb337c85d7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:12.734364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926bf6-c5f5-4775-9437-91eb337c85d7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:12.734364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926bf6-c5f5-4775-9437-91eb337c85d7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:12.735641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 590/1162] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:12.743717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:12.744499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:12.744679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:12.769696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:12.770930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:12.829667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:12.852985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 573/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:12.887254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926bf6-c5f5-4775-9437-91eb337c85d7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:13.016709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926bf6-c5f5-4775-9437-91eb337c85d7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:13.046507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:13.052471 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:13.053116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:13.053398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:13.053668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:13.124067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:13.125502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:13.224705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 591/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:59:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:59:13.234285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:13.340524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be8417-e111-452c-b1e1-f3d5f733c1e4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:13.376281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:13.377088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:13.377366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:13.377638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:13.384863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:13.386315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6d63d136-81ad-454c-b65a-7f27bd52c044 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:13.400753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:13.401899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:59:13.402906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 574/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 06:59:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:13.408272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:13.442745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:13.514785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c73b09-f3cf-4e39-bcbf-35e0d68f09fc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:13.550768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:13.551417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:13.551694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:13.551999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:13.552740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:13.553047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:13.554412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eae48-8ecd-4af3-b5e5-55103fff070b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:13.561537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 592/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jun 24 06:59:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:15.540967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c90e-c319-4a50-8257-d6d864c955be None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:15.541516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c90e-c319-4a50-8257-d6d864c955be None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:15.541516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c90e-c319-4a50-8257-d6d864c955be None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:15.542893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 575/1167] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:15.549298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ca101-3919-4612-abdb-e53edd15d34c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:15.550070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ca101-3919-4612-abdb-e53edd15d34c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:15.550166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ca101-3919-4612-abdb-e53edd15d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:15.569285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d03ca101-3919-4612-abdb-e53edd15d34c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:15.570444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d03ca101-3919-4612-abdb-e53edd15d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:15.641817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 593/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:15.672708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c90e-c319-4a50-8257-d6d864c955be None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:15.727267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:15.779144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c90e-c319-4a50-8257-d6d864c955be None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:15.814483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851caf3-6dff-4709-9479-de69e4a22d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:15.815132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851caf3-6dff-4709-9479-de69e4a22d22 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:15.815410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851caf3-6dff-4709-9479-de69e4a22d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:15.815684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851caf3-6dff-4709-9479-de69e4a22d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:15.816454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851caf3-6dff-4709-9479-de69e4a22d22 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:15.817821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851caf3-6dff-4709-9479-de69e4a22d22 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:15.832984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 576/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Fri Jun 24 06:59:15 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:59:17.856985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d6c7-17d4-4e7f-81b1-045e5ffd78fa None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:17.857853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d6c7-17d4-4e7f-81b1-045e5ffd78fa None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:17.857853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d6c7-17d4-4e7f-81b1-045e5ffd78fa None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:17.860108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 594/1170] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:17.866054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:17.866469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:17.866558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:17.884475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:17.885653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:17.959012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 577/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:17.983189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d6c7-17d4-4e7f-81b1-045e5ffd78fa None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:18.013156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:18.101563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d6c7-17d4-4e7f-81b1-045e5ffd78fa None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:18.140773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada02ca-3d0e-4251-b0fa-46ee896cfc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:18.141578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada02ca-3d0e-4251-b0fa-46ee896cfc49 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:18.141864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada02ca-3d0e-4251-b0fa-46ee896cfc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:18.142137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada02ca-3d0e-4251-b0fa-46ee896cfc49 None admin] PATH_INFO: `/v3/domains/e161d121f3c44508af9ab8537922d817` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:18.155118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada02ca-3d0e-4251-b0fa-46ee896cfc49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e161d121f3c44508af9ab8537922d817)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:18.156608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada02ca-3d0e-4251-b0fa-46ee896cfc49 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:18.158223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 595/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Jun 24 06:59:17 2022] GET /identity/v3/domains/e161d121f3c44508af9ab8537922d817 => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:18.164459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:18.203834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:18.263541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e48d9-d7a7-40da-ad22-cf6e6b7989f5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:18.298065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d0f6c-ef9b-4b47-9d24-52201d0f1ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:18.298710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d0f6c-ef9b-4b47-9d24-52201d0f1ac6 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:18.298996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d0f6c-ef9b-4b47-9d24-52201d0f1ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:18.299270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d0f6c-ef9b-4b47-9d24-52201d0f1ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:18.300022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d0f6c-ef9b-4b47-9d24-52201d0f1ac6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:18.301444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d0f6c-ef9b-4b47-9d24-52201d0f1ac6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:18.329862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 578/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 06:59:18 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 06:59:20.361011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a20260-f4de-4f7e-93e2-02c24bda394c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:20.361665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a20260-f4de-4f7e-93e2-02c24bda394c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:20.361665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a20260-f4de-4f7e-93e2-02c24bda394c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:20.362937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 596/1174] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:20.368536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:20.368999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:20.369092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:20.387492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:20.388692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:20.465379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 579/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:20.494204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a20260-f4de-4f7e-93e2-02c24bda394c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:20.601586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:20.620521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a20260-f4de-4f7e-93e2-02c24bda394c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:20.658407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbb9d2-34b2-4fcc-862d-6121b11a5a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:20.659744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb9d2-34b2-4fcc-862d-6121b11a5a6b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:20.660144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb9d2-34b2-4fcc-862d-6121b11a5a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:20.660501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb9d2-34b2-4fcc-862d-6121b11a5a6b None admin] PATH_INFO: `/v3/domains/e161d121f3c44508af9ab8537922d817` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:20.662708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbb9d2-34b2-4fcc-862d-6121b11a5a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=e161d121f3c44508af9ab8537922d817)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:20.665061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbb9d2-34b2-4fcc-862d-6121b11a5a6b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:20.667588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 597/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Jun 24 06:59:20 2022] GET /identity/v3/domains/e161d121f3c44508af9ab8537922d817 => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:20.673672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:20.696508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:20.779020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22f3a-6153-472d-999a-58f29cd88ffd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:20.819204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1631ca4-5080-44af-bfd2-48851a69ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:20.819882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631ca4-5080-44af-bfd2-48851a69ba8b None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:20.820174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631ca4-5080-44af-bfd2-48851a69ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:20.820443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631ca4-5080-44af-bfd2-48851a69ba8b None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:20.821157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1631ca4-5080-44af-bfd2-48851a69ba8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:20.822590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1631ca4-5080-44af-bfd2-48851a69ba8b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:20.848340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 580/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 06:59:20 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 06:59:22.962195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2582961-6fb8-4bb8-80ee-419f2cacf52f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:22.962765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2582961-6fb8-4bb8-80ee-419f2cacf52f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:22.962765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2582961-6fb8-4bb8-80ee-419f2cacf52f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:22.964200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 598/1178] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:22.969658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:22.970116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:22.970207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:22.988146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:22.989324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:23.059802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 581/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:23.093119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2582961-6fb8-4bb8-80ee-419f2cacf52f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:23.208577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2582961-6fb8-4bb8-80ee-419f2cacf52f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:23.243651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:23.244413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:23.244692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:23.244965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:23.255491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:59:23.263146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:23.264368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:59:23.265613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 599/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:23.270480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:23.278743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:23.372461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9006bba-50ea-412c-a844-6060b98000f5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:23.410362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:23.411065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:23.411342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:23.411682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:23.412481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:23.412787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:23.414166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:23.422603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 582/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:23.428668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:23.444310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:23.531159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68c5d7-7780-453e-9f2d-27cb6b394ed0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:23.567127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:23.568070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:23.568353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:23.568626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] PATH_INFO: `/v3/users/029330ac9b214dfbbfe8e2609bc4c1c5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:23.583608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] RBAC: Authorizing `identity:get_user(user_id=029330ac9b214dfbbfe8e2609bc4c1c5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:23.585095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:23.586749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 600/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:59:23 2022] GET /identity/v3/users/029330ac9b214dfbbfe8e2609bc4c1c5 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:23.592947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:23.667415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:23.704984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e624-c27b-48bf-a6b2-2751622a6e89 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:23.741279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:23.741921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:23.742200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:23.742473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:23.811324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:23.812805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:23.883818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:23.924348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 583/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:59:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:59:23.930498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:24.002288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:24.035005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb64a6e-48ed-4ebb-a590-a8ed81fd5c8e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:24.069814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ace0-b959-4759-a96a-94b5332ccc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:24.070597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ace0-b959-4759-a96a-94b5332ccc2f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:24.070874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ace0-b959-4759-a96a-94b5332ccc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:24.071143 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ace0-b959-4759-a96a-94b5332ccc2f None admin] PATH_INFO: `/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:24.072452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ace0-b959-4759-a96a-94b5332ccc2f None admin] RBAC: Authorizing `identity:get_project(project_id=4544ab64126b4444910cfdf1a3f4ae4f)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:24.073888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ace0-b959-4759-a96a-94b5332ccc2f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:24.075551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 601/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:59:23 2022] GET /identity/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:24.082252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:24.190867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832a077-54a6-479d-a763-8152b8b52e7b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:24.226766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:24.227402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:24.227670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:24.227949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:24.229117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=4544ab64126b4444910cfdf1a3f4ae4f, user.id=029330ac9b214dfbbfe8e2609bc4c1c5) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:24.229416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:24.230832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edc7ca-9920-488a-bc15-2aca817bfe40 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:24.236579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 584/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:59:24 2022] GET /identity/v3/role_assignments?user.id=029330ac9b214dfbbfe8e2609bc4c1c5&scope.project.id=4544ab64126b4444910cfdf1a3f4ae4f&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:26.216372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113b31-8f9c-47d0-8a15-dcdb6eae99e8 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:26.217285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113b31-8f9c-47d0-8a15-dcdb6eae99e8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:26.217285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113b31-8f9c-47d0-8a15-dcdb6eae99e8 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:26.219379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 602/1186] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:26.225955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:26.226414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:26.226513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:26.254064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:26.255758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:26.282631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:26.326304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 585/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:26.358286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4113b31-8f9c-47d0-8a15-dcdb6eae99e8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:26.470603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4113b31-8f9c-47d0-8a15-dcdb6eae99e8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:26.506276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:26.507085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:26.507364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:26.507633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:26.515608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:26.518941 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:59:26.527489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:26.528561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 06:59:26.529427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 603/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:26.537463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:26.643925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7125f9-2b92-4996-b647-263875fd1561 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:26.678690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:26.679334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:26.679612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:26.679889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:26.680645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:26.680953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:26.682314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:26.690375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 586/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:26.698719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:26.804046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ea78c-ccc3-43da-8427-5d0daf602470 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:26.841561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:26.842426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:26.842701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:26.842972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] PATH_INFO: `/v3/users/029330ac9b214dfbbfe8e2609bc4c1c5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:26.844300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] RBAC: Authorizing `identity:get_user(user_id=029330ac9b214dfbbfe8e2609bc4c1c5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:26.845732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:26.847343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 604/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:59:26 2022] GET /identity/v3/users/029330ac9b214dfbbfe8e2609bc4c1c5 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:26.859226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:26.890207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:26.977244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87c8c-a95d-46cd-a147-3501895d9e8c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:27.012437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7efa57-3a70-4865-9f5e-39495d4ea79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:27.013293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7efa57-3a70-4865-9f5e-39495d4ea79f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:27.013565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7efa57-3a70-4865-9f5e-39495d4ea79f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:27.013835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7efa57-3a70-4865-9f5e-39495d4ea79f None admin] PATH_INFO: `/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:27.015132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7efa57-3a70-4865-9f5e-39495d4ea79f None admin] RBAC: Authorizing `identity:get_project(project_id=4544ab64126b4444910cfdf1a3f4ae4f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:27.016592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7efa57-3a70-4865-9f5e-39495d4ea79f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:27.018281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 587/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:59:26 2022] GET /identity/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:27.024608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:27.093012 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:27.134538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338789-68a0-4f90-b236-8200ab3f7641 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:27.173154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d05e4-ca4d-4869-9fa5-97f761559c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:27.174043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d05e4-ca4d-4869-9fa5-97f761559c63 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:27.174321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d05e4-ca4d-4869-9fa5-97f761559c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:27.174596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d05e4-ca4d-4869-9fa5-97f761559c63 None admin] PATH_INFO: `/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f/users/029330ac9b214dfbbfe8e2609bc4c1c5/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:27.176937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d05e4-ca4d-4869-9fa5-97f761559c63 None admin] RBAC: Authorizing `identity:create_grant(project_id=4544ab64126b4444910cfdf1a3f4ae4f, user_id=029330ac9b214dfbbfe8e2609bc4c1c5, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:27.178377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d05e4-ca4d-4869-9fa5-97f761559c63 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:27.195711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 605/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 06:59:27 2022] PUT /identity/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f/users/029330ac9b214dfbbfe8e2609bc4c1c5/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 06:59:29.163200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2980b-f15a-432e-9513-186b48c470ba None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:29.164093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2980b-f15a-432e-9513-186b48c470ba None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:29.164093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2980b-f15a-432e-9513-186b48c470ba None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:29.166397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 588/1193] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 06:59:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 06:59:29.171797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:29.172264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:29.172353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:29.191151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 06:59:29.192369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 06:59:29.262223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 606/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 06:59:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 06:59:29.286460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2980b-f15a-432e-9513-186b48c470ba None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:29.393570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:29.404066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2980b-f15a-432e-9513-186b48c470ba None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:29.438277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:29.438992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:29.439266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:29.439539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:29.450817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 06:59:29.458449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 06:59:29.459513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 06:59:29.460733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 589/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 06:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 06:59:29.466284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:29.530832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:29.574447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8ebc1-faf7-48ba-9658-c1d8a1af2833 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:29.610560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:29.611220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:29.611496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:29.611747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:29.612590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:29.612900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:29.614273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:29.622451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 607/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 06:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:29.631669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:29.744279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3a0b-820b-418f-aad8-c99eee4b5914 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:29.791539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:29.792432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:29.792711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:29.792980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] PATH_INFO: `/v3/users/029330ac9b214dfbbfe8e2609bc4c1c5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:29.794308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] RBAC: Authorizing `identity:get_user(user_id=029330ac9b214dfbbfe8e2609bc4c1c5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:29.795740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:29.797380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 590/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jun 24 06:59:29 2022] GET /identity/v3/users/029330ac9b214dfbbfe8e2609bc4c1c5 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:29.805010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:29.907528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31d73-ff22-4ee1-9cd8-68d2bac5f421 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:29.926698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:29.941166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:29.941816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:29.942097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:29.942367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:30.010546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:30.011951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:30.111482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 608/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 06:59:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 06:59:30.120347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:30.145585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:30.225887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46607d22-1e06-4679-8a0c-d2ae5f6833f5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:30.262186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8827b-d626-4d04-b583-1a7a1fb92041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:30.262980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8827b-d626-4d04-b583-1a7a1fb92041 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:30.263258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8827b-d626-4d04-b583-1a7a1fb92041 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:30.263533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8827b-d626-4d04-b583-1a7a1fb92041 None admin] PATH_INFO: `/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:30.264872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8827b-d626-4d04-b583-1a7a1fb92041 None admin] RBAC: Authorizing `identity:get_project(project_id=4544ab64126b4444910cfdf1a3f4ae4f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:30.266307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8827b-d626-4d04-b583-1a7a1fb92041 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:30.268031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 591/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jun 24 06:59:30 2022] GET /identity/v3/projects/4544ab64126b4444910cfdf1a3f4ae4f => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:30.274386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 06:59:30.299444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:30.380157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f76cc-d004-4b32-b300-6b76c875352a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 06:59:30.415897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 06:59:30.416564 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 06:59:30.416847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 06:59:30.417111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 06:59:30.417943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=4544ab64126b4444910cfdf1a3f4ae4f, user.id=029330ac9b214dfbbfe8e2609bc4c1c5) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 06:59:30.418246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 06:59:30.419668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abeca2-b4b2-40b0-bedd-8cb40251340c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 06:59:30.425838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 609/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 06:59:30 2022] GET /identity/v3/role_assignments?user.id=029330ac9b214dfbbfe8e2609bc4c1c5&scope.project.id=4544ab64126b4444910cfdf1a3f4ae4f&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 06:59:40.256893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=56 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 06:59:40.423119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=58 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:25.231832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdba3cf-1085-4b03-b573-778589a2e1ce None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:25.232456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdba3cf-1085-4b03-b573-778589a2e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:25.232456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdba3cf-1085-4b03-b573-778589a2e1ce None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:25.234431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 592/1201] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:25.240475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:25.240970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:25.241068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:25.260067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:25.261525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:25.347133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 610/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:00:25.375973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdba3cf-1085-4b03-b573-778589a2e1ce None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:25.502340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdba3cf-1085-4b03-b573-778589a2e1ce None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:25.548512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:25.549327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:25.549658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:25.550038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:25.561683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:25.563236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:25.584154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:25.585682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:25.587313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:25.587313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:25.587313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:25.587313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:25.587313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 593/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:25.594644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:25.715049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361986-da15-4bde-8a58-22845a9301b6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:25.757764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:25.765432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:25.766120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:25.766405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:25.766680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:25.767531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:25.767912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:25.769464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1badd-26cf-4a07-b3e1-d38ba4a621b7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:25.783420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 611/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:25.793207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:25.858718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:25.918950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dac7-97c0-4709-870b-deaf1d787225 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:25.959532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c45c25-87bb-44a1-85b8-8bfab6ff46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:25.960262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45c25-87bb-44a1-85b8-8bfab6ff46d5 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:25.960536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45c25-87bb-44a1-85b8-8bfab6ff46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:25.960798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45c25-87bb-44a1-85b8-8bfab6ff46d5 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:25.961509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c45c25-87bb-44a1-85b8-8bfab6ff46d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:25.962941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c45c25-87bb-44a1-85b8-8bfab6ff46d5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:25.987015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 594/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jun 24 07:00:25 2022] POST /identity/v3/users => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:00:28.342554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb7ae-d79c-4385-b718-2953ffae0c1a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:28.343271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb7ae-d79c-4385-b718-2953ffae0c1a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:28.343271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb7ae-d79c-4385-b718-2953ffae0c1a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:28.344548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 612/1206] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:28.352654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:28.353143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:28.353253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:28.373094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:28.374476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:28.457059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 595/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:28.485735 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb7ae-d79c-4385-b718-2953ffae0c1a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:28.621462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb7ae-d79c-4385-b718-2953ffae0c1a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:28.662170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:28.663011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:28.663332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:28.663713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:28.675748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:00:28.683872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:28.684836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:28.685701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 613/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 07:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:28.691315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:28.743050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:28.817860 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfb9bf-67d2-47a7-a27d-5f934ef248b6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:28.855721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:28.856582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:28.856852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:28.857205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:28.858030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:28.858290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:28.859673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:28.868544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 596/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 07:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:28.876779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:28.929320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:28.984157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38a2b-12c0-4764-93bb-38d5b63bf388 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:29.023628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:29.024558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:29.024919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:29.026238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:29.037208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:29.038663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:29.063107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:29.064170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:29.072470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:29.072470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:29.072470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:29.072470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:29.072470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 614/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:29.074648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:29.193554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:29.196710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67574d-2e49-4bc6-9e20-a868de86c9aa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:29.237324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:29.238021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:29.238306 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:29.238592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:29.239342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:29.239663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:29.241098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:29.254109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 597/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:29.259932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:29.372703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01725-b66e-4d68-b69e-b12c9dff4063 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:29.375085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:29.414369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:29.415199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:29.415479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:29.415756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:29.426196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:29.428673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:00:29.447123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:29.448325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:29.454211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 615/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:29.456848 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:29.587356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747dfd-fc7a-41ef-a516-fe4d2512a214 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:29.628420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:29.629510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:29.629783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:29.630079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:29.630938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:29.631245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:29.632918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:29.652457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 598/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jun 24 07:00:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:29.658780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:29.769981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98119bb-0e8e-4eb4-b713-f5ee9f6c53c0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:29.807348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55572367-c625-4155-854b-9be9297d685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:29.808050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572367-c625-4155-854b-9be9297d685e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:29.808334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572367-c625-4155-854b-9be9297d685e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:29.808682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572367-c625-4155-854b-9be9297d685e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:29.845090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:29.891697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55572367-c625-4155-854b-9be9297d685e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:29.893348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55572367-c625-4155-854b-9be9297d685e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:30.011308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 616/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 07:00:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:00:30.018318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:30.044285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:30.134695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58006410-d5eb-48aa-81ad-c24d4d7ec5e5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:30.176779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:30.177666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:30.178089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:30.178470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:30.194203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:30.196164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:30.215720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:30.216907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:30.217994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:30.217994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:30.217994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:30.217994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:30.222248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 599/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 07:00:30.223508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55572367-c625-4155-854b-9be9297d685e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:30.290715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:30.334846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55572367-c625-4155-854b-9be9297d685e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:30.374168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:30.374751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:30.375048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:30.375324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:30.376146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:30.376386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:30.377752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:30.390828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 617/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:30.398792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:30.480955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:30.513890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885850-34c2-4b99-b6ba-f5f92d9dec29 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:30.552342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:30.553219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:30.553501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:30.553799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:30.561485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:30.562961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:00:30.578313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:30.579280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:30.580662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 600/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 07:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:30.585964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:30.699968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeb88d-956f-4dac-b705-1f4a5adaf2df None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:30.729220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:30.748485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:30.749245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:30.749591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:30.749911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:30.750899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:30.751265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:30.752905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082b186-a167-4d56-8e2b-2de2494267cc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:30.768545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 618/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 07:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:30.774729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:30.886954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45954a3-db8e-4361-aec6-f949c48f8ecf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:30.917164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:30.924795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:30.925667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:30.926048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:30.926405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:30.927480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=6637a4d8b7104d158d4d9952cc2a5216) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:30.928008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:30.929512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732666-989c-41c1-a013-96ccb5659a14 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:30.935570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 601/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 07:00:30 2022] GET /identity/v3/role_assignments?user.id=6637a4d8b7104d158d4d9952cc2a5216&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:33.073078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faaa6a-e4f3-45d4-86b4-0c51388197ac None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:33.073715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faaa6a-e4f3-45d4-86b4-0c51388197ac None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:33.073715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faaa6a-e4f3-45d4-86b4-0c51388197ac None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:33.074996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 619/1220] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:00:33.080427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728bda-630f-457c-b76c-544876db2a69 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:33.080834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728bda-630f-457c-b76c-544876db2a69 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:33.080995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728bda-630f-457c-b76c-544876db2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:33.098025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-21728bda-630f-457c-b76c-544876db2a69 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:33.099293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21728bda-630f-457c-b76c-544876db2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:33.180662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 602/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:33.207659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faaa6a-e4f3-45d4-86b4-0c51388197ac None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:33.320089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faaa6a-e4f3-45d4-86b4-0c51388197ac None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:33.356056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:33.356909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:33.357254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:33.357620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:33.369580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:00:33.377680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:33.378976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:33.380372 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 620/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 07:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:33.385722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728bda-630f-457c-b76c-544876db2a69 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:33.495953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728bda-630f-457c-b76c-544876db2a69 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:33.520601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:33.532283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:33.532945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:33.533216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:33.533532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:33.534241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:33.534544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:33.535949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:33.544632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 603/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 07:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:33.550676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:33.597314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:33.660224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446699-0d31-47e9-99e5-18122f65c233 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:33.693197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:33.694004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:33.694287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:33.694564 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:33.705137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:33.706605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:33.723681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:33.724888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:33.725935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:33.725935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:33.725935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:33.725935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:33.725935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 621/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:33.731443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:33.842290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c293-53f9-4b5e-8e68-4716ddb64d9f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:33.878877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:33.879552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:33.879876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:33.880227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:33.880959 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:33.881269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:33.882643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:33.894889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 604/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:33.900840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:33.996502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:34.004828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a131f2-8b28-4a9a-97fb-868fa506c55f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:34.042855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:34.043672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:34.043988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:34.044260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:34.051715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:34.053308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:00:34.071203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:34.072316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:34.073951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 622/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:34.079386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:34.132896 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:34.198917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e271ac-0f42-4d64-bcdd-fd442f200723 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:34.234370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:34.235123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:34.235403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:34.235677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:34.236542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:34.236845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:34.238267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:34.256262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 605/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jun 24 07:00:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:34.264038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:34.372183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0aa6ff-5724-48d4-b981-51fbc86e306d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:34.406622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:34.408587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:34.408895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:34.409173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:34.421535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:34.422978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:34.443225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:34.444417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:34.445577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:34.445577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:34.445577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:34.445577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:34.449955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 623/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:34.450995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:34.568318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f3bd3-6a14-4002-849e-0c9fb7b8cd33 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:34.570642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:34.603619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:34.604689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:34.604967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:34.605243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:34.605965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:34.606273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:34.607648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:34.623878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 606/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:34.627174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:34.637222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:34.738300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa269d87-5aeb-46ef-a13a-cbbabd0e4503 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:34.775593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:34.776434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:34.776728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:34.777002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:34.783655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:34.785294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:00:34.803853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:34.804991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:34.810907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 624/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 07:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:34.811398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:34.937266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7da02-3219-4b64-ad0b-fd659011cf4b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:34.975829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:34.976543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:34.976819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:34.977174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:34.978054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:34.978451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:34.980621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76cb0-7bea-4141-871d-40153150b792 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:34.997683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 607/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 07:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:35.003963 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:35.075736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:35.114700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846afdd2-04e2-46f9-9ff5-6f13d545e074 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:35.154162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6818d97-e3f5-4083-8ded-b51ca3e7d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:35.155489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6818d97-e3f5-4083-8ded-b51ca3e7d3fd None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:35.155800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6818d97-e3f5-4083-8ded-b51ca3e7d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:35.156122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6818d97-e3f5-4083-8ded-b51ca3e7d3fd None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/6637a4d8b7104d158d4d9952cc2a5216/roles/c8e340f100aa4754acddf42aa06c0153` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:35.174680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6818d97-e3f5-4083-8ded-b51ca3e7d3fd None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=6637a4d8b7104d158d4d9952cc2a5216, role_id=c8e340f100aa4754acddf42aa06c0153)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:35.176249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6818d97-e3f5-4083-8ded-b51ca3e7d3fd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:35.190049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 625/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 07:00:35 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/6637a4d8b7104d158d4d9952cc2a5216/roles/c8e340f100aa4754acddf42aa06c0153 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:00:37.284467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed085c1-a25f-440f-a53c-69efb3d324e9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:37.285052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed085c1-a25f-440f-a53c-69efb3d324e9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:37.285052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed085c1-a25f-440f-a53c-69efb3d324e9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:37.286384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 608/1233] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:00:37.291618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:37.292106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:37.292367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:37.310736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:37.311945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:37.392258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 626/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:37.416539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed085c1-a25f-440f-a53c-69efb3d324e9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:37.443027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:37.523746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed085c1-a25f-440f-a53c-69efb3d324e9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:37.559174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:37.560009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:37.560289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:37.560558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:37.572128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:00:37.580017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:37.581690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:37.582952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 609/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jun 24 07:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:37.587502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:37.640685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:37.696459 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d3603-2239-4396-8cce-464172cecd13 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:37.732611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:37.733359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:37.733626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:37.733876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:37.734763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:37.735040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:37.736544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:37.746257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 627/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jun 24 07:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:37.752098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:37.844474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:37.867369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3a6e-7055-4827-be49-ff76a86fd503 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:37.912051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:37.912934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:37.913204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:37.913499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:37.925354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:37.926843 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:37.945631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:37.947918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:37.950394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:37.950394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:37.950394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:37.950394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:37.950394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 610/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:37.954942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:38.074700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fbbe-325e-4a05-9b6f-2a0bce754e38 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:38.086691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:38.115165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:38.115774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:38.116088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:38.116363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:38.117107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:38.117421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:38.118856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:38.131669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 628/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:38.137715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:38.268489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac425a-a613-4dcc-a67c-556fdde5f7a8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:38.307814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:38.308917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:38.309201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:38.309475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:38.312979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:38.319147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:38.321262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:00:38.336599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:38.337720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:38.338877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:38.342826 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 611/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:38.343825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:38.452553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59c671-55d5-4dca-8b00-7a3669e80889 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:38.491471 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:38.492300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:38.492613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:38.492898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:38.493820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:38.494151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:38.495623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:38.515519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 629/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jun 24 07:00:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:38.521549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:38.630694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba161b79-0852-45fd-b931-a6b1883cda53 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:38.671631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:38.672507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:38.672858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:38.673133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:38.741968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:38.750481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:38.752178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:38.877471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 612/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 07:00:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:00:38.880526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:38.912400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:38.991051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97049-ab57-464b-80e0-d7dbd55d019a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:39.028111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:39.029118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:39.029463 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:39.029822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:39.040784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:39.042270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:39.060054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:39.061221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:39.067271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:39.067271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:39.067271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:39.067271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:39.067271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 630/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:39.068906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:39.181674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:39.188439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f86ecb-946f-4297-a622-09d03f0d5f31 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:39.230810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:39.231695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:39.232093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:39.232431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:39.233490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:39.233846 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:39.235311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:39.250174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 613/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:39.256908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:39.345364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:39.377513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc287c-bda1-4539-a114-6218202c63b9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:39.417163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:39.417969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:39.418296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:39.418541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:39.426738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:39.428338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:00:39.446768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:39.447950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:39.449342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 631/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 07:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:39.454415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:39.564915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a96e01-3931-43ef-b86a-6692f83a6790 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:39.603667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:39.604731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:39.605018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:39.605295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:39.606093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:39.606405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:39.608150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96e52b-3623-4b5d-b868-83d6a59ad1f1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:39.621226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 614/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 07:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:39.627718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:39.743385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772a365-ed73-4972-ab83-b6dcec701e21 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:39.779222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:39.779879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:39.780162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:39.780433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:39.781260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] RBAC: Adding query filter params (role.id=c8e340f100aa4754acddf42aa06c0153, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=6637a4d8b7104d158d4d9952cc2a5216) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:39.781567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:39.782998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60124bd-25f9-40a1-a561-553ff1184f1f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:39.788925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 632/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 07:00:39 2022] GET /identity/v3/role_assignments?user.id=6637a4d8b7104d158d4d9952cc2a5216&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c8e340f100aa4754acddf42aa06c0153 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:42.029519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3f0be-ed9b-4866-9a16-305dd4e6ccfb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:42.030114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3f0be-ed9b-4866-9a16-305dd4e6ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:42.030114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3f0be-ed9b-4866-9a16-305dd4e6ccfb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:42.031496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 615/1247] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:42.036823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:42.037246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:42.037407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:42.042599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:42.056045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:42.057287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:42.137350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 633/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:42.162937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3f0be-ed9b-4866-9a16-305dd4e6ccfb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:42.187053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:42.288759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3f0be-ed9b-4866-9a16-305dd4e6ccfb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:42.330797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:42.331605 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:42.331924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:42.332200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:42.344495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:00:42.352484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:42.353654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:42.359915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 616/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 07:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:42.361301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:42.470634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ef60e-6406-4a82-a9e5-623ff548b9c0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:42.502647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:42.508216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:42.508953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:42.509235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:42.509510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:42.510330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:42.510705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:42.512339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:42.521592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 634/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 07:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:42.527436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:42.629241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:42.658364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f8b2-6db7-4d80-9392-b3abdc0f2619 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:42.702142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:42.703088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:42.703428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:42.703760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:42.720243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:42.722914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:42.743064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:42.744270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:42.745376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:42.745376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:42.745376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:42.745376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:42.749358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 617/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:42.750482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:42.869036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd712d-930f-44ba-b422-817d6053ff17 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:42.906138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:42.907207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:42.907716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:42.910225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:42.910225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:42.910541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:42.911832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:42.925584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 635/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:42.931377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:43.043122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698e83-52a6-4124-8cb9-f90abbce447f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:43.072191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:43.080959 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:43.081899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:43.082177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:43.082459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:43.091326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:43.092808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:00:43.110582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:43.111755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:43.112944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 618/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:43.117832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:43.182447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:43.235890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700dafe-6bc6-4e94-b760-187bfc03595c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:43.277623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:43.278504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:43.278781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:43.279052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:43.280006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:43.280375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:43.282115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:43.301995 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 636/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jun 24 07:00:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:43.308062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:43.423177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f530b8-7f4e-49e4-8d45-d438f4b83d41 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:43.459928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:43.460502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:43.460782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:43.461054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:43.523935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:43.538869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:43.540387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:43.641457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 619/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 07:00:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:00:43.647263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:43.763692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c156-139b-4e2a-81ab-7a137ff78475 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:43.783705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:43.808597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:43.809451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:43.809732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:43.810002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:43.820775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:43.822237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:43.843547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:43.844824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:43.851498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:43.851498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:43.851498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:43.851498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:43.851498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 637/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:43.851925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:43.948198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:43.963899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e723-51e9-4788-acb3-cdf6c74da4d0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:44.003299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:44.004351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:44.004811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:44.005193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:44.006327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:44.006851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:44.008784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:44.025710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 620/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:44.032635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:44.141639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9c3da-af54-419f-b5f6-4e8227d6ce74 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:44.180887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:44.181767 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:44.182276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:44.182493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:44.190546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:44.192157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:00:44.208472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:44.209510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:44.210399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:44.214919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 638/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 07:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:44.215923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:44.321427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a53631-d28e-44d8-a01a-05de27359664 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:44.359858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:44.360611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:44.360805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:44.361077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:44.361862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:44.362169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:44.363663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00640230-faf1-44d7-8323-89b816f0834d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:44.378681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 621/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 07:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:44.385485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:44.412139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:44.492254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0c24c-d2fb-43d7-b349-5081d93439ad None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:44.533105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:44.533760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:44.534041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:44.534314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:44.535149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=6637a4d8b7104d158d4d9952cc2a5216) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:44.535457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:44.537037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ef16-8136-401b-a949-f6c5b885eec5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:44.544137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 639/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 07:00:44 2022] GET /identity/v3/role_assignments?user.id=6637a4d8b7104d158d4d9952cc2a5216&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c55009d9dd08464ebde7f96db3459dea => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:46.536162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8ae3-3c31-4dd5-a5f4-8df2e9e37c63 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:46.536736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8ae3-3c31-4dd5-a5f4-8df2e9e37c63 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:46.536736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8ae3-3c31-4dd5-a5f4-8df2e9e37c63 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:46.538153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 622/1261] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:46.544910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:46.545649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:46.545833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:46.572182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:46.573367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:46.643130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 640/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:46.672853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8ae3-3c31-4dd5-a5f4-8df2e9e37c63 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:46.684313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:46.781075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8ae3-3c31-4dd5-a5f4-8df2e9e37c63 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:46.816008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:46.816772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:46.817044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:46.817341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:46.828233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:00:46.836052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:46.837092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:46.837992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 623/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 07:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:46.843633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:46.865666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:46.957909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8556fa-f06e-4a9b-bc7d-d40f46f2264c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:46.994756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:46.995418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:46.995693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:46.995993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:46.996738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:46.997039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:46.998424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:47.007457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 641/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 07:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:47.013967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:47.084544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:47.119256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e994d-885c-4190-ac7c-80ee5c08eee7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:47.155003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:47.156038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:47.156381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:47.156781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:47.168973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:47.170554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:47.191363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:47.192577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:47.193646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:47.193646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:47.193646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:47.193646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:47.193646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 624/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:47.200245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:47.284788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:47.317168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb08843-8e7a-43d1-ae88-ac676cef564a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:47.356058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:47.356725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:47.357011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:47.357289 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:47.358020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:47.358332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:47.359717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:47.371731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 642/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:47.379581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:47.481977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198b964-e16c-45f3-8d6d-43fa912ab7a8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:47.501614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:47.519547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:47.520384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:47.520736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:47.521042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:47.528973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:47.530405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:00:47.545150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:47.546552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:47.547599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 625/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:47.553146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:47.658790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ce06-98a3-4355-a7be-1ed88023fb44 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:47.701263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:47.702253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:47.702652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:47.703078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:47.704450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:47.704908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:47.707187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:47.716593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:47.725739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 643/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jun 24 07:00:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:47.732135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:47.835575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081ef03-6778-47c3-a1b0-4a32d2e7f633 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:47.869598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:47.870376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:47.870646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:47.870907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:47.883277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:47.885678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:47.913584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:47.914669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:47.916135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:47.916135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:47.916135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:47.916135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:47.916135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 626/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:47.921183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:48.028755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56caeb-c34a-45f2-a5e7-bd201d7e4679 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:48.063561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:48.064243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:48.064519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:48.064790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:48.065508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:48.065810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:48.067174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:48.078430 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 644/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:00:48.087355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:48.129528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:48.207779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499def-fa55-4a36-9f4f-cf28c594f839 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:48.242475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:48.243259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:48.243534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:48.243800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:48.250672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:48.252146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:00:48.266485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:48.267502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:48.268784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 627/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 07:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:48.273741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:48.335643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:48.377733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4603-8412-4b8b-a3c4-1aaf0744200b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:48.413187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:48.413840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:48.414122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:48.414390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:48.415176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:48.415481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:48.416935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a70d2c-2df3-409c-84bc-9b3ec87036f0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:48.428877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 645/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 07:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:48.435595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:48.553333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:48.564413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0756a-0924-482e-b0ee-d49daeb28a15 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:48.601168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd973a-6938-4041-acbb-edcb7d8b93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:48.602047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd973a-6938-4041-acbb-edcb7d8b93b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:48.602324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd973a-6938-4041-acbb-edcb7d8b93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:48.602593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd973a-6938-4041-acbb-edcb7d8b93b1 None admin] PATH_INFO: `/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/6637a4d8b7104d158d4d9952cc2a5216/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:48.604964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd973a-6938-4041-acbb-edcb7d8b93b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=417b0c9162d04d2791a27bc718d0d5e4, user_id=6637a4d8b7104d158d4d9952cc2a5216, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:48.606388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd973a-6938-4041-acbb-edcb7d8b93b1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:48.621406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 628/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jun 24 07:00:48 2022] PUT /identity/v3/projects/417b0c9162d04d2791a27bc718d0d5e4/users/6637a4d8b7104d158d4d9952cc2a5216/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:00:50.606328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500b35-5bf2-4e75-baf5-bbe8d6b654bd None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:50.607188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500b35-5bf2-4e75-baf5-bbe8d6b654bd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:50.607793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500b35-5bf2-4e75-baf5-bbe8d6b654bd None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:50.612075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 646/1274] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:50.619163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:50.619889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:50.620134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:50.646440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:50.647615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:50.721230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 629/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:50.746201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500b35-5bf2-4e75-baf5-bbe8d6b654bd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:50.866964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500b35-5bf2-4e75-baf5-bbe8d6b654bd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:50.884621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:50.905730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:50.906451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:50.906731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:50.906996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:50.918279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 07:00:50.926484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:50.927541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:50.928618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 647/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jun 24 07:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:50.933880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:51.023552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:51.047087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8c14-144b-43f2-8adb-ab576b548fa4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:51.091742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:51.092441 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:51.092732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:51.092998 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:51.093757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:51.094085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:51.095460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:51.104274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 630/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jun 24 07:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:51.113254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:51.232345 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf1fc-b21c-4740-a19f-6de227b86700 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:51.270714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:51.271500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:51.271781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:51.272081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:51.283046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:51.284528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:51.301797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:51.302780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:51.304162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:51.304162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:51.304162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:51.304162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:51.304162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 648/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:51.311940 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:51.427056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285087-5451-47a7-b49a-d146e42bb893 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:51.461687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:51.462336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:51.462615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:51.462884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:51.463597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:51.463889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:51.465290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:51.477043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 631/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:51.483815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:51.519586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:51.594585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5437a4-dfeb-4713-aa65-5d53a59cc1fc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:51.635045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:51.635861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:51.636158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:51.636435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:51.644403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:51.645880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 07:00:51.660414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:51.661518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:51.662616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 649/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:51.669652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:51.673749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:51.791399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff036701-ef4b-4ef7-acd8-a00d7df32a02 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:51.826824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:51.827496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:51.827773 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:51.828080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:51.828920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:51.829226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:51.830660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:51.847915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 632/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jun 24 07:00:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:51.858140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:51.972773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:51.989239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53cfb-488f-4394-8457-b0bb964b5e32 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:52.035252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:52.035886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:52.036205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:52.036477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:52.111670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:52.113068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:52.215712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:52.230332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 650/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jun 24 07:00:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 07:00:52.236689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:52.307621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:52.360177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fe58-ce0e-4be2-9183-b59d01604abd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:52.398537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:52.399374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:52.399653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:52.399950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:52.410809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:52.412839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 07:00:52.432235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:52.433251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:52.438300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 07:00:52.438300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 07:00:52.438300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 07:00:52.438300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:52.438300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 633/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:52.439287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:52.551468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d0dc-1b84-4d81-bd72-679b71eb0a08 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:52.585441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:52.586107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:52.586392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:52.586667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:52.587395 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:52.587704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:52.589129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:52.600595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 651/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jun 24 07:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:52.606862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:52.713346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074a32e-18b1-4312-a386-ade9ca004e7b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:52.727443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:52.753157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:52.753944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:52.754195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:52.754487 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:52.761539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:52.762963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 07:00:52.777135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:52.778192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jun 24 07:00:52.779355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 634/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jun 24 07:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:52.786530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:52.844812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:52.899133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebde12-81ef-413b-95f8-6830e38dd04b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:52.934969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:52.935621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:52.935896 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:52.936207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:52.936997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:52.937306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:52.938737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d53fe1-50b3-494e-a4c8-b9158378a7db None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:52.950756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 652/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jun 24 07:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:52.957071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:53.072005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00d1d-e7ae-4abb-ad0f-899f6d6b5765 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:53.109532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:53.110168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:53.110445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:53.110723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:53.111553 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] RBAC: Adding query filter params (role.id=c55009d9dd08464ebde7f96db3459dea, scope.project.id=417b0c9162d04d2791a27bc718d0d5e4, user.id=6637a4d8b7104d158d4d9952cc2a5216) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:53.111892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:53.113312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e68c6-f37d-4a85-a3c4-a0a3bdd761b2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:53.119857 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 635/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jun 24 07:00:52 2022] GET /identity/v3/role_assignments?user.id=6637a4d8b7104d158d4d9952cc2a5216&scope.project.id=417b0c9162d04d2791a27bc718d0d5e4&role.id=c55009d9dd08464ebde7f96db3459dea => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:55.125917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a223-c879-41bd-9293-88d165c8037d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:55.126806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a223-c879-41bd-9293-88d165c8037d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:55.126806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a223-c879-41bd-9293-88d165c8037d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:55.129097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 653/1288] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:55.134592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:55.135040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:55.135139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:55.153245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:55.154436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:55.185793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:55.234075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 636/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:55.257103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30a223-c879-41bd-9293-88d165c8037d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:55.364808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30a223-c879-41bd-9293-88d165c8037d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:55.375414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:55.400692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:55.401426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:55.401711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:55.401982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:55.402637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:55.404053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:00:55.416438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:00:55.417605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:00:55.418627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 654/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 07:00:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:00:55.423830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:55.531966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8bc1c-5301-4f8a-ab80-beef19b62993 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:55.568059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:55.568715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:55.568990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:55.569259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:55.569969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:55.570262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:55.571626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a671-ae19-4651-ba99-ab62d7a8ca2c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:55.576585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 637/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jun 24 07:00:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:55.585699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:55.698460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b6ca-b9a3-4cab-b4ae-82523ee04e38 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:55.733643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:55.734299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:55.734580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:55.734849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:55.735556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:00:55.735957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:55.737323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7772d-8fab-45ab-afb8-f3b554496909 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:55.742007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 655/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jun 24 07:00:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:00:57.721689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352bfda-7f09-4463-a079-879f630bb858 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:57.722233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352bfda-7f09-4463-a079-879f630bb858 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:57.722233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352bfda-7f09-4463-a079-879f630bb858 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:57.723584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 638/1293] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:00:57.730215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd33d4-9447-4797-9253-8d758c43c64f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:57.730936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd33d4-9447-4797-9253-8d758c43c64f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:57.731068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd33d4-9447-4797-9253-8d758c43c64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:57.757749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7dbd33d4-9447-4797-9253-8d758c43c64f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:00:57.758920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7dbd33d4-9447-4797-9253-8d758c43c64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:00:57.790659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:57.832815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 656/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:00:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:00:57.856602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352bfda-7f09-4463-a079-879f630bb858 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:00:57.893016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:00:57.966792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352bfda-7f09-4463-a079-879f630bb858 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:00:58.002349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba15f-2509-4bfe-8f6c-06904b7ff521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:00:58.002936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba15f-2509-4bfe-8f6c-06904b7ff521 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:00:58.003215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba15f-2509-4bfe-8f6c-06904b7ff521 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:00:58.003484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba15f-2509-4bfe-8f6c-06904b7ff521 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:00:58.004238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba15f-2509-4bfe-8f6c-06904b7ff521 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:00:58.005946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba15f-2509-4bfe-8f6c-06904b7ff521 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:00:58.025269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 639/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jun 24 07:00:57 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:01:00.025897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09809-904a-4242-b811-f9efcbc953a1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:00.026831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09809-904a-4242-b811-f9efcbc953a1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:00.026831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09809-904a-4242-b811-f9efcbc953a1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:00.028948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 657/1296] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:01:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:01:00.036777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:00.037210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:00.037301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:00.054463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:01:00.055624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:01:00.135969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 640/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:01:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 07:01:00.168576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09809-904a-4242-b811-f9efcbc953a1 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:00.275799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09809-904a-4242-b811-f9efcbc953a1 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:00.311305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:00.312129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:00.312409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:00.312681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:00.313339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:00.314711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:01:00.327047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:01:00.328115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:01:00.328984 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 658/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 07:01:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:01:00.334306 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:00.355614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:01:00.454373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8155d9-763f-415f-bab6-5c23b0a3097c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:00.490329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:00.490991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:00.491270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:00.491544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:00.492292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:01:00.492597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:00.493974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:00.499273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 641/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jun 24 07:01:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:01:00.508712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:00.546893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:01:00.617128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d420b-09ce-47d4-9191-e51f77486ec5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:00.651492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:00.652168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:00.652445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:00.652714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:00.653503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] RBAC: Adding query filter params (interface=public, service_id=393c26bd1cb542258665ed3fa9e46e9b, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:01:00.653813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:00.655183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444606d0-a23c-4245-a05a-655ea442a24e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:00.660368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 659/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jun 24 07:01:00 2022] GET /identity/v3/endpoints?service_id=393c26bd1cb542258665ed3fa9e46e9b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:01:00.666787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:00.771067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:01:00.790444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de844-d038-473a-a1a5-e423d8f97143 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:00.825388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc5393-11b3-4f0a-a16e-b8d481aed470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:00.826035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5393-11b3-4f0a-a16e-b8d481aed470 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:00.826311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5393-11b3-4f0a-a16e-b8d481aed470 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:00.826581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5393-11b3-4f0a-a16e-b8d481aed470 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:00.827575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc5393-11b3-4f0a-a16e-b8d481aed470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:00.828963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc5393-11b3-4f0a-a16e-b8d481aed470 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:00.835628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 642/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jun 24 07:01:00 2022] GET /identity/v3/services => generated 2191 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:01:02.821413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95026aca-7a39-4fc3-b955-6ac8a700fcc1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:02.822275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95026aca-7a39-4fc3-b955-6ac8a700fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:02.822275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95026aca-7a39-4fc3-b955-6ac8a700fcc1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:02.824616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 660/1302] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:01:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:01:02.830881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:02.831329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:02.831433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:02.849559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:01:02.850743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:01:02.919374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 643/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:01:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 07:01:02.947314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95026aca-7a39-4fc3-b955-6ac8a700fcc1 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:03.057992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:01:03.066421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95026aca-7a39-4fc3-b955-6ac8a700fcc1 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:03.104496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:03.105240 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:03.105518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:03.105786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:03.106436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:03.107803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 07:01:03.120227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 07:01:03.121344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jun 24 07:01:03.122483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 661/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jun 24 07:01:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 07:01:03.127579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:03.217079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:01:03.247966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1493e7a-a853-4f61-b165-b13627e6f3d8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:03.294795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:03.295452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:03.295728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:03.296031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:03.296738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:01:03.297042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:03.298408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c90eda-cbf3-440d-bdac-dd0cd88ffe60 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:03.304164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 644/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jun 24 07:01:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:01:03.313562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:01:03.433639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adf890-8a8f-41ed-8fe9-86d3bcef29ab None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:01:03.468519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1387d-db86-43d5-bf82-efe1deb35104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:01:03.469195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1387d-db86-43d5-bf82-efe1deb35104 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:01:03.469480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1387d-db86-43d5-bf82-efe1deb35104 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:01:03.469753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1387d-db86-43d5-bf82-efe1deb35104 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:01:03.470493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1387d-db86-43d5-bf82-efe1deb35104 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:01:03.471888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1387d-db86-43d5-bf82-efe1deb35104 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:01:03.494931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 662/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jun 24 07:01:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:01:13.300584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=30 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:01:13.489880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:06.188502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d9f0b-6d88-4898-9d7f-c0acd678d700 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:06.189397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d9f0b-6d88-4898-9d7f-c0acd678d700 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:06.189836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d9f0b-6d88-4898-9d7f-c0acd678d700 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:06.191459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 645/1307] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:06.198992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae103f-69b8-4a2f-97ef-f60871eee427 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:06.199526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae103f-69b8-4a2f-97ef-f60871eee427 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:06.199526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae103f-69b8-4a2f-97ef-f60871eee427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:06.399413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8eae103f-69b8-4a2f-97ef-f60871eee427 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:06.400897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8eae103f-69b8-4a2f-97ef-f60871eee427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:06.568323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 663/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:02:06.651383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880e29c-b384-4fa9-abb8-79df7492299f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:06.651829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880e29c-b384-4fa9-abb8-79df7492299f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:06.652406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880e29c-b384-4fa9-abb8-79df7492299f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:06.654681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 646/1309] 10.222.0.27 () {54 vars in 964 bytes} [Fri Jun 24 07:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:06.663425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa10a6-ce3a-4264-b2c9-806f3e3c5eae None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:06.663971 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa10a6-ce3a-4264-b2c9-806f3e3c5eae None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:06.664295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa10a6-ce3a-4264-b2c9-806f3e3c5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:06.765979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-deaa10a6-ce3a-4264-b2c9-806f3e3c5eae None None] MFA Rules not processed for user `d6e8bab40c4b4f029d9ac7600d756797`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:06.768088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-deaa10a6-ce3a-4264-b2c9-806f3e3c5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:06.804723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:06.924048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 664/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Jun 24 07:02:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:06.933782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880e29c-b384-4fa9-abb8-79df7492299f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:06.935693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7880e29c-b384-4fa9-abb8-79df7492299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:07.063074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880e29c-b384-4fa9-abb8-79df7492299f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:07.142980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:07.143546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:07.143832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:07.144135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:07.145792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:07.210530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:07.278987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:07.280529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b0bf7-6959-4ca2-9a83-f0bd96f1e077 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:07.304882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 647/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:09.710214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1659ef-75b6-4a14-b7d9-9cc56fdca834 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:09.710745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1659ef-75b6-4a14-b7d9-9cc56fdca834 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:09.710745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1659ef-75b6-4a14-b7d9-9cc56fdca834 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:09.712082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 665/1312] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:09.717447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdaccb-d149-487d-bb51-b9fd0b0ea9d0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:09.717894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdaccb-d149-487d-bb51-b9fd0b0ea9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:09.717999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdaccb-d149-487d-bb51-b9fd0b0ea9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:09.800750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-04bdaccb-d149-487d-bb51-b9fd0b0ea9d0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:09.801958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-04bdaccb-d149-487d-bb51-b9fd0b0ea9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:09.924017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 648/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:09.978905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ec87b-e188-4fc9-a688-7974fd88e7a8 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:09.979110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ec87b-e188-4fc9-a688-7974fd88e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:09.979357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ec87b-e188-4fc9-a688-7974fd88e7a8 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:09.981077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 666/1314] 10.222.0.27 () {54 vars in 964 bytes} [Fri Jun 24 07:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:09.987477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9fe8e-3f48-4c68-8ab4-8d4f5090825e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:09.987718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9fe8e-3f48-4c68-8ab4-8d4f5090825e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:09.988067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9fe8e-3f48-4c68-8ab4-8d4f5090825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:09.998823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:10.062315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-56d9fe8e-3f48-4c68-8ab4-8d4f5090825e None None] MFA Rules not processed for user `d6e8bab40c4b4f029d9ac7600d756797`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:10.063494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-56d9fe8e-3f48-4c68-8ab4-8d4f5090825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:10.140482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 649/1315] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Jun 24 07:02:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:10.151563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ec87b-e188-4fc9-a688-7974fd88e7a8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:10.153734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-740ec87b-e188-4fc9-a688-7974fd88e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:10.276660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ec87b-e188-4fc9-a688-7974fd88e7a8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:10.352447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:10.355878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:10.356748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:10.357218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:10.357579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:10.359474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:10.482661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:10.484189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08111968-fb28-4a21-84f6-fd471de06f3a service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:10.508511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 667/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:13.135484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a096-4413-46a1-abf0-73f372997606 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:13.136370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a096-4413-46a1-abf0-73f372997606 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:13.136370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a096-4413-46a1-abf0-73f372997606 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:13.138506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 650/1317] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:13.144772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c868-7f55-4ac3-8037-192d22617039 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:13.145202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c868-7f55-4ac3-8037-192d22617039 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:13.145371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c868-7f55-4ac3-8037-192d22617039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:13.226219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ab52c868-7f55-4ac3-8037-192d22617039 None None] MFA Rules not processed for user `987e32a36dc249e0be2146ea2ea7edc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:13.227444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab52c868-7f55-4ac3-8037-192d22617039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:13.281577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:13.330233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 668/1318] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:13.379311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a096-4413-46a1-abf0-73f372997606 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:13.381634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed31a096-4413-46a1-abf0-73f372997606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:13.495553 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a096-4413-46a1-abf0-73f372997606 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:13.498301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:13.572692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:13.573335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:13.573611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:13.573881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:13.575514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:13.689091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:13.690521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d3e1b-5f15-46c7-911c-b3e85c30fc6c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:13.712225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 651/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:16.304166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a1c1-e0a4-49c1-8461-d0287c99ea35 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:16.304981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a1c1-e0a4-49c1-8461-d0287c99ea35 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:16.304981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a1c1-e0a4-49c1-8461-d0287c99ea35 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:16.307262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 669/1320] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:16.317728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3371-4c0b-44d9-af26-6d9529017478 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:16.318162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3371-4c0b-44d9-af26-6d9529017478 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:16.318313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b3371-4c0b-44d9-af26-6d9529017478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:16.362256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:16.390941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dd1b3371-4c0b-44d9-af26-6d9529017478 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:16.392191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dd1b3371-4c0b-44d9-af26-6d9529017478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:16.491091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 652/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:16.535205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206a1c1-e0a4-49c1-8461-d0287c99ea35 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:16.536787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e206a1c1-e0a4-49c1-8461-d0287c99ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:16.664968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206a1c1-e0a4-49c1-8461-d0287c99ea35 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:16.759490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:16.760178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:16.760454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:16.760722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:16.762375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:16.770482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:16.879227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:16.880708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059bfdd-6224-4128-8277-a925581e6f34 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:16.900593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 670/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:19.561509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69e43-4fb1-4445-aca7-ac2d443748bd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:19.562068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69e43-4fb1-4445-aca7-ac2d443748bd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:19.562068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69e43-4fb1-4445-aca7-ac2d443748bd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:19.563440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 653/1323] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:19.568889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4874a-d460-4df7-8238-1f101f6b06ed None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:19.569294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4874a-d460-4df7-8238-1f101f6b06ed None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:19.569437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4874a-d460-4df7-8238-1f101f6b06ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:19.636496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dda4874a-d460-4df7-8238-1f101f6b06ed None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:19.637612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dda4874a-d460-4df7-8238-1f101f6b06ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:19.700669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:19.746051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 671/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:19.782335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69e43-4fb1-4445-aca7-ac2d443748bd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:19.783971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-22c69e43-4fb1-4445-aca7-ac2d443748bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:19.904160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69e43-4fb1-4445-aca7-ac2d443748bd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:19.917774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:19.983867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:19.984526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:19.984807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:19.985082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:19.986743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:20.101293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:20.102749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e67e46-d420-470e-a3f0-1c383f47c2ca service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:20.122038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 654/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:22.186717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e28d-217d-42b4-a6e2-ab3e2d6b4880 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:22.187231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e28d-217d-42b4-a6e2-ab3e2d6b4880 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:22.187231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e28d-217d-42b4-a6e2-ab3e2d6b4880 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:22.188945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 672/1326] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:22.194011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6482234-0f14-48be-8b04-06c80f2321f2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:22.194448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6482234-0f14-48be-8b04-06c80f2321f2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:22.194542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6482234-0f14-48be-8b04-06c80f2321f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:22.244661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:22.266793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b6482234-0f14-48be-8b04-06c80f2321f2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:22.267886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b6482234-0f14-48be-8b04-06c80f2321f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:22.371785 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 655/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:22.407895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602e28d-217d-42b4-a6e2-ab3e2d6b4880 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:22.409469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a602e28d-217d-42b4-a6e2-ab3e2d6b4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:22.516103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602e28d-217d-42b4-a6e2-ab3e2d6b4880 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:22.597316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:22.597974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:22.598252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:22.598521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:22.600253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:22.618281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:22.713284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:22.714776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfa7e6-1f07-4b08-8a6c-41cb37d8f68a service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:22.733794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 673/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:24.814430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad896-1d35-443c-91e5-72211cf6cb72 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:24.815100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad896-1d35-443c-91e5-72211cf6cb72 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:24.815100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad896-1d35-443c-91e5-72211cf6cb72 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:24.816362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 656/1329] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:24.822009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271123ab-e00f-4457-86fc-cb54a32eaa1d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:24.822446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271123ab-e00f-4457-86fc-cb54a32eaa1d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:24.822558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271123ab-e00f-4457-86fc-cb54a32eaa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:24.893591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-271123ab-e00f-4457-86fc-cb54a32eaa1d None None] MFA Rules not processed for user `987e32a36dc249e0be2146ea2ea7edc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:24.894846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-271123ab-e00f-4457-86fc-cb54a32eaa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:24.965022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:25.004268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 674/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:02:25.037446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad896-1d35-443c-91e5-72211cf6cb72 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:25.039071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-548ad896-1d35-443c-91e5-72211cf6cb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:25.151586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad896-1d35-443c-91e5-72211cf6cb72 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:25.172973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:25.226047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:25.226708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:25.226987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:25.227260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:25.228923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:25.351872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:25.353318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d7a6f-75b2-496e-8f3c-220846528a4b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:25.374174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 657/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:27.804488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff004fa-14db-4ff8-8fc0-8bcadc0935ad None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:27.805360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff004fa-14db-4ff8-8fc0-8bcadc0935ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:27.805360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff004fa-14db-4ff8-8fc0-8bcadc0935ad None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:27.807577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 675/1332] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:27.814031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1d11-26b3-4a85-b37e-955c2c4cb152 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:27.814712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1d11-26b3-4a85-b37e-955c2c4cb152 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:27.814892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1d11-26b3-4a85-b37e-955c2c4cb152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:27.883307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:27.886749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-60bc1d11-26b3-4a85-b37e-955c2c4cb152 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:27.889084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-60bc1d11-26b3-4a85-b37e-955c2c4cb152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:28.001231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 658/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:28.041041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff004fa-14db-4ff8-8fc0-8bcadc0935ad None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:28.043606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cff004fa-14db-4ff8-8fc0-8bcadc0935ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:28.156815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff004fa-14db-4ff8-8fc0-8bcadc0935ad None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:28.231932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:28.232582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:28.232861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:28.233129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:28.234759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:28.262453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:28.349886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:28.351351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ff3fb-776d-439f-b350-6664233c378e service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:28.372733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 676/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:30.428526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa57e-8256-4c38-a781-ab0e0a300ddb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:30.429100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa57e-8256-4c38-a781-ab0e0a300ddb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:30.429100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa57e-8256-4c38-a781-ab0e0a300ddb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:30.430928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 659/1335] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:30.438679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84887-f827-4ef0-bbc9-7d540445d8fb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:30.439394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84887-f827-4ef0-bbc9-7d540445d8fb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:30.439548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84887-f827-4ef0-bbc9-7d540445d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:30.516537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-75b84887-f827-4ef0-bbc9-7d540445d8fb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:30.518370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-75b84887-f827-4ef0-bbc9-7d540445d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:30.598181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:30.624503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 677/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:30.673290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa57e-8256-4c38-a781-ab0e0a300ddb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:30.675826 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-069fa57e-8256-4c38-a781-ab0e0a300ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:30.790690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa57e-8256-4c38-a781-ab0e0a300ddb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:30.819331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:30.868240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:30.868821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:30.869103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:30.869374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:30.871030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:30.989221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:30.990712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eabb0-a7a6-4f8f-9e37-e63423d81d31 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:31.010503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 660/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:33.512165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f313d-072f-4c43-b1a7-92efc2b53d6f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:33.513076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f313d-072f-4c43-b1a7-92efc2b53d6f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:33.513076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f313d-072f-4c43-b1a7-92efc2b53d6f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:33.515370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 678/1338] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:33.521838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7d91-a150-4c9f-91f7-1021538cdf7b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:33.522326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7d91-a150-4c9f-91f7-1021538cdf7b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:33.522427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7d91-a150-4c9f-91f7-1021538cdf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:33.597753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ab7d7d91-a150-4c9f-91f7-1021538cdf7b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:33.598978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ab7d7d91-a150-4c9f-91f7-1021538cdf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:33.609081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:33.707230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 661/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:33.750243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f313d-072f-4c43-b1a7-92efc2b53d6f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:33.751785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-745f313d-072f-4c43-b1a7-92efc2b53d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:33.867981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f313d-072f-4c43-b1a7-92efc2b53d6f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:33.943691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:33.944365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:33.944644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:33.944922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:33.946551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:33.984861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:34.060709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:34.062163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358e57-2a94-4de1-9cd4-68d231800a83 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:34.081948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 679/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:38.125871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3556838-ee6b-4746-bee9-00151b40e9e4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:38.126412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3556838-ee6b-4746-bee9-00151b40e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:38.126412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3556838-ee6b-4746-bee9-00151b40e9e4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:38.127746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 662/1341] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:38.133422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689c45-7e87-4b1a-9f7e-405c8c5a49dc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:38.133832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689c45-7e87-4b1a-9f7e-405c8c5a49dc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:38.133985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689c45-7e87-4b1a-9f7e-405c8c5a49dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:38.210083 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fa689c45-7e87-4b1a-9f7e-405c8c5a49dc None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:38.211275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fa689c45-7e87-4b1a-9f7e-405c8c5a49dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:38.311142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:38.325387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 680/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:38.368601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3556838-ee6b-4746-bee9-00151b40e9e4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:38.373379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f3556838-ee6b-4746-bee9-00151b40e9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:38.473304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3556838-ee6b-4746-bee9-00151b40e9e4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:38.477439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6dd96-2b95-4045-aaaa-7a55a9632498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:38.478672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6dd96-2b95-4045-aaaa-7a55a9632498 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:38.478672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6dd96-2b95-4045-aaaa-7a55a9632498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:38.478672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6dd96-2b95-4045-aaaa-7a55a9632498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:38.489175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6dd96-2b95-4045-aaaa-7a55a9632498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:38.490681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6dd96-2b95-4045-aaaa-7a55a9632498 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:38.500719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 663/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:41.128912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752e007-d69d-42c1-80e4-a3e76dd10ccb None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:41.129460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752e007-d69d-42c1-80e4-a3e76dd10ccb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:41.129460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752e007-d69d-42c1-80e4-a3e76dd10ccb None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:41.131008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 681/1344] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:41.136776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7ecf-b512-4f7d-a7b7-883dedc4baf8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:41.137329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7ecf-b512-4f7d-a7b7-883dedc4baf8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:41.137329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7ecf-b512-4f7d-a7b7-883dedc4baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:41.166827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9c2a7ecf-b512-4f7d-a7b7-883dedc4baf8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:41.168052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9c2a7ecf-b512-4f7d-a7b7-883dedc4baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:41.202477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:41.259437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 664/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:41.297785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752e007-d69d-42c1-80e4-a3e76dd10ccb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:41.299974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2752e007-d69d-42c1-80e4-a3e76dd10ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:41.315469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752e007-d69d-42c1-80e4-a3e76dd10ccb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:41.319482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e409a-d118-45b5-8e57-caf2e2a74f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:41.320284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e409a-d118-45b5-8e57-caf2e2a74f73 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:41.320638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e409a-d118-45b5-8e57-caf2e2a74f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:41.320998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e409a-d118-45b5-8e57-caf2e2a74f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:41.332534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e409a-d118-45b5-8e57-caf2e2a74f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:41.333426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e409a-d118-45b5-8e57-caf2e2a74f73 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:41.343393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 682/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:45.565697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c064-ae54-451d-a107-7e5b0ea09f2a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:45.566184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c064-ae54-451d-a107-7e5b0ea09f2a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:45.566294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c064-ae54-451d-a107-7e5b0ea09f2a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:45.567633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 665/1347] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:45.573648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6ddd-1fcb-42cb-89ea-200b3342e2d5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:45.574124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6ddd-1fcb-42cb-89ea-200b3342e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:45.574221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6ddd-1fcb-42cb-89ea-200b3342e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:45.593008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fe5d6ddd-1fcb-42cb-89ea-200b3342e2d5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:45.594236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fe5d6ddd-1fcb-42cb-89ea-200b3342e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:45.602999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 683/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:45.641214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c064-ae54-451d-a107-7e5b0ea09f2a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:02:45.652912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c064-ae54-451d-a107-7e5b0ea09f2a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:02:45.656466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02bedb-0567-44f2-8c98-1de5ab1481fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:02:45.657128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02bedb-0567-44f2-8c98-1de5ab1481fe service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:45.657406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02bedb-0567-44f2-8c98-1de5ab1481fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:45.657696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02bedb-0567-44f2-8c98-1de5ab1481fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:45.667050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02bedb-0567-44f2-8c98-1de5ab1481fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:02:45.668529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02bedb-0567-44f2-8c98-1de5ab1481fe service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:02:45.678049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 666/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:02:50.590952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff7eb-35fd-411b-98ee-8a378407e208 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:50.591403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff7eb-35fd-411b-98ee-8a378407e208 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:50.591505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff7eb-35fd-411b-98ee-8a378407e208 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:50.593305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 684/1350] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:50.598344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee7826-502d-4993-8ddd-e4aa4806ec2a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:50.598760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee7826-502d-4993-8ddd-e4aa4806ec2a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:50.598955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee7826-502d-4993-8ddd-e4aa4806ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:50.760849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-84ee7826-502d-4993-8ddd-e4aa4806ec2a None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:50.762733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-84ee7826-502d-4993-8ddd-e4aa4806ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:50.885283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 667/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:02:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:55.096765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7bac2-bb9a-4773-8167-7abc0d02cc13 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:55.097335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7bac2-bb9a-4773-8167-7abc0d02cc13 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:55.097335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7bac2-bb9a-4773-8167-7abc0d02cc13 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:55.098846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 685/1352] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:55.103813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592329f8-0954-414d-a537-ae01faa5e3dd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:55.104724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592329f8-0954-414d-a537-ae01faa5e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:55.105216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592329f8-0954-414d-a537-ae01faa5e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:55.125083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-592329f8-0954-414d-a537-ae01faa5e3dd None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:55.126500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-592329f8-0954-414d-a537-ae01faa5e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:55.135456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 668/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:02:55.587288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=13 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:02:56.496243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9115fd-599b-4bf0-840c-21a9748873f2 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:56.496948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9115fd-599b-4bf0-840c-21a9748873f2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:56.496948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9115fd-599b-4bf0-840c-21a9748873f2 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:56.498182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 686/1354] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:02:56.503310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc36f40-4ff1-47ce-ae71-a5991ddc74d3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:02:56.503755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc36f40-4ff1-47ce-ae71-a5991ddc74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:02:56.504066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc36f40-4ff1-47ce-ae71-a5991ddc74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:02:56.523010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bfc36f40-4ff1-47ce-ae71-a5991ddc74d3 None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:02:56.524332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bfc36f40-4ff1-47ce-ae71-a5991ddc74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:02:56.533344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 669/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:02:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:00.326097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736b77-4fd5-4221-8a78-9c74f69d64ab None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:00.327025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736b77-4fd5-4221-8a78-9c74f69d64ab None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:00.327506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736b77-4fd5-4221-8a78-9c74f69d64ab None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:00.333871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 687/1356] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:00.336060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3353ad-820c-40c1-9083-de1c3d1a2896 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:00.336887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3353ad-820c-40c1-9083-de1c3d1a2896 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:00.337385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3353ad-820c-40c1-9083-de1c3d1a2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:00.356979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0e3353ad-820c-40c1-9083-de1c3d1a2896 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:00.358272 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0e3353ad-820c-40c1-9083-de1c3d1a2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:00.366281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 670/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:00.419680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484109fe-dea5-4f52-b9ad-c5c2ab1ffe27 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:00.419997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484109fe-dea5-4f52-b9ad-c5c2ab1ffe27 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:00.420280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484109fe-dea5-4f52-b9ad-c5c2ab1ffe27 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:00.421678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 688/1358] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jun 24 07:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:00.428103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376371c-89b6-48a4-b409-1d9e4ae11be3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:00.428444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376371c-89b6-48a4-b409-1d9e4ae11be3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:00.428714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376371c-89b6-48a4-b409-1d9e4ae11be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:00.480247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:03:00.489314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7376371c-89b6-48a4-b409-1d9e4ae11be3 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:00.490791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7376371c-89b6-48a4-b409-1d9e4ae11be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:00.576114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 671/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jun 24 07:03:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:00.584454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484109fe-dea5-4f52-b9ad-c5c2ab1ffe27 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:00.599723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484109fe-dea5-4f52-b9ad-c5c2ab1ffe27 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:00.607819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c967d-d90c-4a76-9e0b-c1943e25cd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:00.608508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c967d-d90c-4a76-9e0b-c1943e25cd9c service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:00.608784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c967d-d90c-4a76-9e0b-c1943e25cd9c service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:00.609068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c967d-d90c-4a76-9e0b-c1943e25cd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:00.618462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c967d-d90c-4a76-9e0b-c1943e25cd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:00.620097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c967d-d90c-4a76-9e0b-c1943e25cd9c service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:00.630046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 689/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:02.877760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9621-ec57-4486-96a4-1c7ff93d1fda None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:02.878310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9621-ec57-4486-96a4-1c7ff93d1fda None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:02.878310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9621-ec57-4486-96a4-1c7ff93d1fda None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:02.879818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 672/1361] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:02.885482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576f1c1-8452-4a29-a877-056d96b1a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:02.885882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576f1c1-8452-4a29-a877-056d96b1a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:02.886011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576f1c1-8452-4a29-a877-056d96b1a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:02.907337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e576f1c1-8452-4a29-a877-056d96b1a5e0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:02.908578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e576f1c1-8452-4a29-a877-056d96b1a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:02.917376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 690/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:02.961594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9621-ec57-4486-96a4-1c7ff93d1fda None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:02.977424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9621-ec57-4486-96a4-1c7ff93d1fda None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:02.983818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ff4c3-0a0c-4ae4-bde8-4fc673587d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:02.984578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ff4c3-0a0c-4ae4-bde8-4fc673587d1a service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:02.984925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ff4c3-0a0c-4ae4-bde8-4fc673587d1a service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:02.985377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ff4c3-0a0c-4ae4-bde8-4fc673587d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:02.994529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ff4c3-0a0c-4ae4-bde8-4fc673587d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:02.996149 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ff4c3-0a0c-4ae4-bde8-4fc673587d1a service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:03.006720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 673/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:05.379568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f979ef-4512-449d-abc0-7c5580615e69 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:05.380159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f979ef-4512-449d-abc0-7c5580615e69 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:05.380159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f979ef-4512-449d-abc0-7c5580615e69 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:05.381716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 691/1364] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:05.387324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aa546-1bd6-43c8-ba83-50a193ab2b76 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:05.387780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aa546-1bd6-43c8-ba83-50a193ab2b76 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:05.387895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aa546-1bd6-43c8-ba83-50a193ab2b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:05.425062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7b3aa546-1bd6-43c8-ba83-50a193ab2b76 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:05.426246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7b3aa546-1bd6-43c8-ba83-50a193ab2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:05.434744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 674/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:05.480882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbebe8-0fac-410c-94c3-57ad77f776ee None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:05.481280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbebe8-0fac-410c-94c3-57ad77f776ee None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:05.481692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbebe8-0fac-410c-94c3-57ad77f776ee None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:05.483334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 692/1366] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jun 24 07:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:05.488921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475cd8-25fa-4f08-80fc-a1438cb5e2d7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:05.489334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475cd8-25fa-4f08-80fc-a1438cb5e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:05.489683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475cd8-25fa-4f08-80fc-a1438cb5e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:05.520178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-33475cd8-25fa-4f08-80fc-a1438cb5e2d7 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:05.522075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-33475cd8-25fa-4f08-80fc-a1438cb5e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:05.531976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 675/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jun 24 07:03:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:05.540024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbebe8-0fac-410c-94c3-57ad77f776ee None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:05.554181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbebe8-0fac-410c-94c3-57ad77f776ee None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:05.559346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d95f9-11b5-405e-b90c-05ffb628c63a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:05.560007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d95f9-11b5-405e-b90c-05ffb628c63a service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:05.560285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d95f9-11b5-405e-b90c-05ffb628c63a service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:05.560550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d95f9-11b5-405e-b90c-05ffb628c63a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:05.568625 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d95f9-11b5-405e-b90c-05ffb628c63a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:05.570188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d95f9-11b5-405e-b90c-05ffb628c63a service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:05.579745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 693/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:07.658151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a7de1-df51-4761-b314-a76c13e0c6fd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:07.658708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a7de1-df51-4761-b314-a76c13e0c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:07.658708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a7de1-df51-4761-b314-a76c13e0c6fd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:07.660156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 676/1369] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:07.666409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc83b55-22ea-46e4-9beb-8927284af089 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:07.667045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc83b55-22ea-46e4-9beb-8927284af089 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:07.667045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc83b55-22ea-46e4-9beb-8927284af089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:07.686569 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cdc83b55-22ea-46e4-9beb-8927284af089 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:07.687799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cdc83b55-22ea-46e4-9beb-8927284af089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:07.696900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 694/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:07.741106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a7de1-df51-4761-b314-a76c13e0c6fd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:07.758090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a7de1-df51-4761-b314-a76c13e0c6fd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:07.764183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863e724-e030-434a-9aa0-bc11efa91040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:07.764948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863e724-e030-434a-9aa0-bc11efa91040 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:07.765329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863e724-e030-434a-9aa0-bc11efa91040 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:07.765704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863e724-e030-434a-9aa0-bc11efa91040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:07.774425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863e724-e030-434a-9aa0-bc11efa91040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:07.776804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863e724-e030-434a-9aa0-bc11efa91040 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:07.787541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 677/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:08.387316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365da2-31da-499b-814e-83984c02812e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:08.387626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365da2-31da-499b-814e-83984c02812e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:08.387889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365da2-31da-499b-814e-83984c02812e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:08.392215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 695/1372] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:08.394733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596a50a-160c-46e0-88b1-2ad763fa2203 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:08.395018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596a50a-160c-46e0-88b1-2ad763fa2203 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:08.395293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596a50a-160c-46e0-88b1-2ad763fa2203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:08.413234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e596a50a-160c-46e0-88b1-2ad763fa2203 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:08.414428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e596a50a-160c-46e0-88b1-2ad763fa2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:08.422500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 678/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:08.737229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699c0c-6717-42fa-a7fd-821fb3fdae66 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:08.737695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699c0c-6717-42fa-a7fd-821fb3fdae66 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:08.737810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699c0c-6717-42fa-a7fd-821fb3fdae66 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:08.739350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 696/1374] 10.222.0.27 () {54 vars in 963 bytes} [Fri Jun 24 07:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:08.744474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30239727-3bb1-43ba-ad4c-dbcbbc67b243 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:08.744925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30239727-3bb1-43ba-ad4c-dbcbbc67b243 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:08.745027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30239727-3bb1-43ba-ad4c-dbcbbc67b243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:08.796984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-30239727-3bb1-43ba-ad4c-dbcbbc67b243 None None] MFA Rules not processed for user `4530cddbad6f4446beaf33a67135257e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:08.798239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-30239727-3bb1-43ba-ad4c-dbcbbc67b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:08.861039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 679/1375] 10.222.0.27 () {58 vars in 1060 bytes} [Fri Jun 24 07:03:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:08.868663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699c0c-6717-42fa-a7fd-821fb3fdae66 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:08.880327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699c0c-6717-42fa-a7fd-821fb3fdae66 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:08.884754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e0ee9-bca3-450f-8c41-9f5a85c0c168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:08.885439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0ee9-bca3-450f-8c41-9f5a85c0c168 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:08.885785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0ee9-bca3-450f-8c41-9f5a85c0c168 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:08.886131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e0ee9-bca3-450f-8c41-9f5a85c0c168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:08.895872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0ee9-bca3-450f-8c41-9f5a85c0c168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:08.897323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e0ee9-bca3-450f-8c41-9f5a85c0c168 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:08.907292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 697/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:09.859510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e089-b5a5-42d1-8606-32fbcafddbe5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:09.860083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e089-b5a5-42d1-8606-32fbcafddbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:09.860083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e089-b5a5-42d1-8606-32fbcafddbe5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:09.861517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 680/1377] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:09.866874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574430dd-05f3-4a3e-92ad-538836d51d60 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:09.867322 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574430dd-05f3-4a3e-92ad-538836d51d60 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:09.867427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574430dd-05f3-4a3e-92ad-538836d51d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:09.885349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-574430dd-05f3-4a3e-92ad-538836d51d60 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:09.886546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-574430dd-05f3-4a3e-92ad-538836d51d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:09.894909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 698/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:09.938757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25e089-b5a5-42d1-8606-32fbcafddbe5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:09.954473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25e089-b5a5-42d1-8606-32fbcafddbe5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:09.960069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56f1cc-64e3-43a8-8b9f-4f710f52ce02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:09.960712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f1cc-64e3-43a8-8b9f-4f710f52ce02 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:09.960991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f1cc-64e3-43a8-8b9f-4f710f52ce02 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:09.961258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f1cc-64e3-43a8-8b9f-4f710f52ce02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:09.969656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56f1cc-64e3-43a8-8b9f-4f710f52ce02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:09.971242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56f1cc-64e3-43a8-8b9f-4f710f52ce02 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:09.975117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:03:09.982363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 681/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:12.030595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb5b2-2153-4b53-9ffb-15606bd494d7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:12.031101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb5b2-2153-4b53-9ffb-15606bd494d7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:12.031101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb5b2-2153-4b53-9ffb-15606bd494d7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:12.032489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 699/1380] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:12.037753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659482-be3f-494a-a22b-0d1ea2b3859a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:12.038230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659482-be3f-494a-a22b-0d1ea2b3859a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:12.038330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659482-be3f-494a-a22b-0d1ea2b3859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:12.056621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b9659482-be3f-494a-a22b-0d1ea2b3859a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:12.057802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b9659482-be3f-494a-a22b-0d1ea2b3859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:12.066975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 682/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:12.111205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb5b2-2153-4b53-9ffb-15606bd494d7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:12.126812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb5b2-2153-4b53-9ffb-15606bd494d7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:12.132612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f885176-7316-4fc3-a324-44c046deb682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:12.133247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885176-7316-4fc3-a324-44c046deb682 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:12.133524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885176-7316-4fc3-a324-44c046deb682 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:12.133797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f885176-7316-4fc3-a324-44c046deb682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:12.141881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f885176-7316-4fc3-a324-44c046deb682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:12.143454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f885176-7316-4fc3-a324-44c046deb682 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:12.152883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 700/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:14.196342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29bdf-ad67-422a-8c2d-baedf2563bd9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:14.196899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29bdf-ad67-422a-8c2d-baedf2563bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:14.196899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29bdf-ad67-422a-8c2d-baedf2563bd9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:14.198414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 683/1383] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:14.203664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1dafe-2351-4546-ab86-cb8ee9ded630 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:14.204098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1dafe-2351-4546-ab86-cb8ee9ded630 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:14.204264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1dafe-2351-4546-ab86-cb8ee9ded630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:14.222619 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c0b1dafe-2351-4546-ab86-cb8ee9ded630 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:14.223807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c0b1dafe-2351-4546-ab86-cb8ee9ded630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:14.233009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 701/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:14.275735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29bdf-ad67-422a-8c2d-baedf2563bd9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:14.292237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29bdf-ad67-422a-8c2d-baedf2563bd9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:14.298089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bdecd-acfb-4ff4-85b8-63089c34660e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:14.298847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bdecd-acfb-4ff4-85b8-63089c34660e service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:14.299245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bdecd-acfb-4ff4-85b8-63089c34660e service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:14.299618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bdecd-acfb-4ff4-85b8-63089c34660e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:14.308736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bdecd-acfb-4ff4-85b8-63089c34660e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:14.312268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bdecd-acfb-4ff4-85b8-63089c34660e service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:14.324760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 684/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:16.365344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d62a6-bac6-4cfa-a67b-e7dd5c9af2b3 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:16.365857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d62a6-bac6-4cfa-a67b-e7dd5c9af2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:16.365954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d62a6-bac6-4cfa-a67b-e7dd5c9af2b3 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:16.367316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 702/1386] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:16.373346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a929385-9dcc-426f-b563-bb30881917b0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:16.373793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a929385-9dcc-426f-b563-bb30881917b0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:16.373885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a929385-9dcc-426f-b563-bb30881917b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:16.393508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3a929385-9dcc-426f-b563-bb30881917b0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:16.394622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3a929385-9dcc-426f-b563-bb30881917b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:16.402641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 685/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:16.447362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d62a6-bac6-4cfa-a67b-e7dd5c9af2b3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:16.461973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d62a6-bac6-4cfa-a67b-e7dd5c9af2b3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:16.467403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6fd3c-6e44-45ce-bebd-d95b0fe6b24a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:16.468092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6fd3c-6e44-45ce-bebd-d95b0fe6b24a service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:16.468376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6fd3c-6e44-45ce-bebd-d95b0fe6b24a service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:16.468648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6fd3c-6e44-45ce-bebd-d95b0fe6b24a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:16.477057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6fd3c-6e44-45ce-bebd-d95b0fe6b24a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:16.478648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6fd3c-6e44-45ce-bebd-d95b0fe6b24a service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:16.488599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 703/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:18.697545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ddf8e-49ba-4b71-8b88-bc578a168d3d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:18.698102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ddf8e-49ba-4b71-8b88-bc578a168d3d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:18.698102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ddf8e-49ba-4b71-8b88-bc578a168d3d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:18.699443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 686/1389] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:03:18.705075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8036d9-5663-4a78-97cc-c9c47d3770bf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:18.705516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8036d9-5663-4a78-97cc-c9c47d3770bf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:18.705609 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8036d9-5663-4a78-97cc-c9c47d3770bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:18.730201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8e8036d9-5663-4a78-97cc-c9c47d3770bf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:18.732407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8e8036d9-5663-4a78-97cc-c9c47d3770bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:18.745074 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 704/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:18.790257 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ddf8e-49ba-4b71-8b88-bc578a168d3d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:18.806690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ddf8e-49ba-4b71-8b88-bc578a168d3d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:18.812579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c651e9e-c409-4321-b335-8ecec2f9a6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:18.813251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c651e9e-c409-4321-b335-8ecec2f9a6d4 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:18.813527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c651e9e-c409-4321-b335-8ecec2f9a6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:18.813798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c651e9e-c409-4321-b335-8ecec2f9a6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:18.822475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c651e9e-c409-4321-b335-8ecec2f9a6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:18.824091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c651e9e-c409-4321-b335-8ecec2f9a6d4 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:18.833557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 687/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:21.408328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2f13-1b6f-4e37-bb4a-d29cd139c028 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:21.408979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2f13-1b6f-4e37-bb4a-d29cd139c028 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:21.409082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2f13-1b6f-4e37-bb4a-d29cd139c028 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:21.411079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 705/1392] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:21.418123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a2e02-c850-4ced-8f88-a732cfb64ea3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:21.418737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a2e02-c850-4ced-8f88-a732cfb64ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:21.418737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a2e02-c850-4ced-8f88-a732cfb64ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:21.440236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7f3a2e02-c850-4ced-8f88-a732cfb64ea3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:21.441906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7f3a2e02-c850-4ced-8f88-a732cfb64ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:21.452682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 688/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:21.501808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e2f13-1b6f-4e37-bb4a-d29cd139c028 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:21.521971 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e2f13-1b6f-4e37-bb4a-d29cd139c028 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:21.529739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1f02b-56cd-4818-b7b7-42fcd1e1cd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:21.530640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1f02b-56cd-4818-b7b7-42fcd1e1cd40 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:21.531009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1f02b-56cd-4818-b7b7-42fcd1e1cd40 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:21.531371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1f02b-56cd-4818-b7b7-42fcd1e1cd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:21.543039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1f02b-56cd-4818-b7b7-42fcd1e1cd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:21.545572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1f02b-56cd-4818-b7b7-42fcd1e1cd40 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:21.558634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 706/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:23.676960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84727-d3ed-4bec-933b-cc7c161ef13c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:23.677664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84727-d3ed-4bec-933b-cc7c161ef13c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:23.677664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84727-d3ed-4bec-933b-cc7c161ef13c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:23.679011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 689/1395] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:23.684745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e37d5-24fc-449f-a51d-98a6d8319626 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:23.685200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e37d5-24fc-449f-a51d-98a6d8319626 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:23.685464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e37d5-24fc-449f-a51d-98a6d8319626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:23.704731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-374e37d5-24fc-449f-a51d-98a6d8319626 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:23.705941 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-374e37d5-24fc-449f-a51d-98a6d8319626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:23.715334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 707/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:23.759772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a84727-d3ed-4bec-933b-cc7c161ef13c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:23.775823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a84727-d3ed-4bec-933b-cc7c161ef13c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:23.781986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c5af5-fcfb-49f4-a278-ed1e0b579737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:23.782639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c5af5-fcfb-49f4-a278-ed1e0b579737 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:23.782925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c5af5-fcfb-49f4-a278-ed1e0b579737 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:23.783202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c5af5-fcfb-49f4-a278-ed1e0b579737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:23.792764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c5af5-fcfb-49f4-a278-ed1e0b579737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:23.794377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c5af5-fcfb-49f4-a278-ed1e0b579737 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:23.804718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 690/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:23.991696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd94b2-672b-472d-ad90-ebc92f5b4952 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:23.991951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd94b2-672b-472d-ad90-ebc92f5b4952 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:23.992182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd94b2-672b-472d-ad90-ebc92f5b4952 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:23.993922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 708/1398] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:23.999650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988e69-3527-480b-bc76-d0f7b704d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:23.999938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988e69-3527-480b-bc76-d0f7b704d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:24.000243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988e69-3527-480b-bc76-d0f7b704d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:24.019670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-aa988e69-3527-480b-bc76-d0f7b704d0e6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:24.020918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aa988e69-3527-480b-bc76-d0f7b704d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:24.029794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 691/1399] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:24.088467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75e5ce-884e-4de0-9ac6-7216c132132a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:24.088748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75e5ce-884e-4de0-9ac6-7216c132132a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:24.089027 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75e5ce-884e-4de0-9ac6-7216c132132a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:24.090410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 709/1400] 10.222.0.27 () {54 vars in 962 bytes} [Fri Jun 24 07:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:24.095459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd0bd-225e-4851-a3d1-f33f06ac0fe5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:24.095744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd0bd-225e-4851-a3d1-f33f06ac0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:24.096167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd0bd-225e-4851-a3d1-f33f06ac0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:24.145460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b55bd0bd-225e-4851-a3d1-f33f06ac0fe5 None None] MFA Rules not processed for user `d928c6bee9f744c082c98811fcb35629`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:24.146701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b55bd0bd-225e-4851-a3d1-f33f06ac0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:24.207674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 692/1401] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Jun 24 07:03:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:24.215571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75e5ce-884e-4de0-9ac6-7216c132132a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:24.226260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75e5ce-884e-4de0-9ac6-7216c132132a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:24.229838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69df2e-b5a9-49cb-916b-3cda1c12f2fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:24.230472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69df2e-b5a9-49cb-916b-3cda1c12f2fc service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:24.231095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69df2e-b5a9-49cb-916b-3cda1c12f2fc service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:24.231362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69df2e-b5a9-49cb-916b-3cda1c12f2fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:24.240779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69df2e-b5a9-49cb-916b-3cda1c12f2fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:24.242264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69df2e-b5a9-49cb-916b-3cda1c12f2fc service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:24.251788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 710/1402] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:24.977081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08488db-25da-4f2f-9ae2-5c9be710f7e5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:24.977594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08488db-25da-4f2f-9ae2-5c9be710f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:24.977703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08488db-25da-4f2f-9ae2-5c9be710f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.029273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f08488db-25da-4f2f-9ae2-5c9be710f7e5 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:25.030455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f08488db-25da-4f2f-9ae2-5c9be710f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:25.073367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:03:25.098546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 693/1403] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:03:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:25.144390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9cc7f-7d0f-4d96-9e3e-8d1495bdaa2b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:25.144874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9cc7f-7d0f-4d96-9e3e-8d1495bdaa2b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:25.144981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9cc7f-7d0f-4d96-9e3e-8d1495bdaa2b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.146480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 711/1404] 10.222.0.27 () {54 vars in 942 bytes} [Fri Jun 24 07:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:25.152842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09c6f-63b0-4b1b-8050-6eae7f3959ad None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:25.153258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09c6f-63b0-4b1b-8050-6eae7f3959ad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:25.153475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09c6f-63b0-4b1b-8050-6eae7f3959ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.202807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8bb09c6f-63b0-4b1b-8050-6eae7f3959ad None None] MFA Rules not processed for user `f528585e29824f548ba7b76848bd0f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:25.204007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8bb09c6f-63b0-4b1b-8050-6eae7f3959ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:25.277078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 694/1405] 10.222.0.27 () {58 vars in 1039 bytes} [Fri Jun 24 07:03:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:03:25.286898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9cc7f-7d0f-4d96-9e3e-8d1495bdaa2b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:25.300754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9cc7f-7d0f-4d96-9e3e-8d1495bdaa2b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:25.305847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9173bf-5cdc-48cf-a5d5-20430ca513ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:25.306489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9173bf-5cdc-48cf-a5d5-20430ca513ad service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:25.306771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9173bf-5cdc-48cf-a5d5-20430ca513ad service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:25.307050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9173bf-5cdc-48cf-a5d5-20430ca513ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.315236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9173bf-5cdc-48cf-a5d5-20430ca513ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:25.316860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9173bf-5cdc-48cf-a5d5-20430ca513ad service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:25.325681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 712/1406] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:03:25.851035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb81d9-ce6b-4440-941c-a2a6195344b4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:25.851323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb81d9-ce6b-4440-941c-a2a6195344b4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:25.851606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb81d9-ce6b-4440-941c-a2a6195344b4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.853484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 695/1407] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:25.859338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fcc5d-542d-4799-adc9-bc8b50d6efa2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:25.859631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fcc5d-542d-4799-adc9-bc8b50d6efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:25.859957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fcc5d-542d-4799-adc9-bc8b50d6efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.869888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=67 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:03:25.884212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3b8fcc5d-542d-4799-adc9-bc8b50d6efa2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:25.885504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3b8fcc5d-542d-4799-adc9-bc8b50d6efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:25.893540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 713/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:25.938302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb81d9-ce6b-4440-941c-a2a6195344b4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:25.952958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb81d9-ce6b-4440-941c-a2a6195344b4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:25.958438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bf054-3949-42e2-ba8c-08a9ac874247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:25.959090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bf054-3949-42e2-ba8c-08a9ac874247 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:25.959370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bf054-3949-42e2-ba8c-08a9ac874247 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:25.959644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bf054-3949-42e2-ba8c-08a9ac874247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:25.968346 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bf054-3949-42e2-ba8c-08a9ac874247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:25.970567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bf054-3949-42e2-ba8c-08a9ac874247 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:25.979583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 696/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:35.877633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:03:35.975348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=59 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:03:47.043801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09c76-7d03-41a8-b15c-9a7804cd9388 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:47.044435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09c76-7d03-41a8-b15c-9a7804cd9388 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:47.044435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09c76-7d03-41a8-b15c-9a7804cd9388 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:47.045821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 714/1410] 10.222.0.27 () {54 vars in 918 bytes} [Fri Jun 24 07:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:03:47.051909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9a1bb-3ade-4fca-afb8-c7e88b70d1d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:47.052347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9a1bb-3ade-4fca-afb8-c7e88b70d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:47.052449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9a1bb-3ade-4fca-afb8-c7e88b70d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:47.076775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ebe9a1bb-3ade-4fca-afb8-c7e88b70d1d6 None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:47.078002 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ebe9a1bb-3ade-4fca-afb8-c7e88b70d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:47.087640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 697/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Jun 24 07:03:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:47.102068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f696-2a38-45e7-ade2-eeb34874b4d7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:47.102360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f696-2a38-45e7-ade2-eeb34874b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:47.102646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f696-2a38-45e7-ade2-eeb34874b4d7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:47.104061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 715/1412] 10.222.0.27 () {54 vars in 918 bytes} [Fri Jun 24 07:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:47.109075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5fffd-ac62-44b7-93cf-747e01aeb049 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:47.109364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5fffd-ac62-44b7-93cf-747e01aeb049 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:47.109638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5fffd-ac62-44b7-93cf-747e01aeb049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:47.128740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d3b5fffd-ac62-44b7-93cf-747e01aeb049 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:47.129913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d3b5fffd-ac62-44b7-93cf-747e01aeb049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:47.139890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 698/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Jun 24 07:03:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:49.673262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa4ea-2b0d-4385-9eb3-c5ee6ea482ec None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:49.674047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa4ea-2b0d-4385-9eb3-c5ee6ea482ec None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:49.674047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffa4ea-2b0d-4385-9eb3-c5ee6ea482ec None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:49.676003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:49.681582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f880-877a-45ab-a0bd-13fa6f633c7f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:49.682004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f880-877a-45ab-a0bd-13fa6f633c7f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:49.682092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f880-877a-45ab-a0bd-13fa6f633c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:49.700178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7735f880-877a-45ab-a0bd-13fa6f633c7f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:49.701364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7735f880-877a-45ab-a0bd-13fa6f633c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:49.710026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:03:49.764798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa4ea-2b0d-4385-9eb3-c5ee6ea482ec None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:49.780552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffa4ea-2b0d-4385-9eb3-c5ee6ea482ec None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:49.786119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35423e25-62de-467f-91df-f8838f7537c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:49.786765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35423e25-62de-467f-91df-f8838f7537c7 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:49.787140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35423e25-62de-467f-91df-f8838f7537c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:49.787419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35423e25-62de-467f-91df-f8838f7537c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:49.795740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35423e25-62de-467f-91df-f8838f7537c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:49.797408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35423e25-62de-467f-91df-f8838f7537c7 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:49.807079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 717/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:50.732809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798b84-1aee-4fed-be55-1578a4efc70d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:50.733705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798b84-1aee-4fed-be55-1578a4efc70d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:50.733705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798b84-1aee-4fed-be55-1578a4efc70d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:50.736035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:50.741834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0f753-502c-46d9-b811-879aa525147c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:50.742594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0f753-502c-46d9-b811-879aa525147c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:50.742729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0f753-502c-46d9-b811-879aa525147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:50.766507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-08f0f753-502c-46d9-b811-879aa525147c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:50.767692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-08f0f753-502c-46d9-b811-879aa525147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:50.776853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:50.928107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798b84-1aee-4fed-be55-1578a4efc70d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:50.944924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798b84-1aee-4fed-be55-1578a4efc70d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:50.951749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6a80a-fc8c-40ba-b992-5c11263ccb28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:50.952433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6a80a-fc8c-40ba-b992-5c11263ccb28 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:50.952712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6a80a-fc8c-40ba-b992-5c11263ccb28 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:50.952982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6a80a-fc8c-40ba-b992-5c11263ccb28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:50.962288 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6a80a-fc8c-40ba-b992-5c11263ccb28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:50.963884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6a80a-fc8c-40ba-b992-5c11263ccb28 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:50.973844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 701/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:51.859391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0a833-de61-45a8-be80-a7c27e1205b1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:51.860234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0a833-de61-45a8-be80-a7c27e1205b1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:51.860234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0a833-de61-45a8-be80-a7c27e1205b1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:51.862456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:51.867716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25562336-c57e-405a-92b9-0dd75b5637e2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:51.868194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25562336-c57e-405a-92b9-0dd75b5637e2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:51.868288 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25562336-c57e-405a-92b9-0dd75b5637e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:51.887458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-25562336-c57e-405a-92b9-0dd75b5637e2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:51.888685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-25562336-c57e-405a-92b9-0dd75b5637e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:51.897581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:52.046686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0a833-de61-45a8-be80-a7c27e1205b1 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:52.069964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0a833-de61-45a8-be80-a7c27e1205b1 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:52.076085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06659c-b7d9-44bf-a1a3-be777ba48eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:52.076738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06659c-b7d9-44bf-a1a3-be777ba48eaa service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:52.077022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06659c-b7d9-44bf-a1a3-be777ba48eaa service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:52.077300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06659c-b7d9-44bf-a1a3-be777ba48eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:52.085892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06659c-b7d9-44bf-a1a3-be777ba48eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:52.087593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06659c-b7d9-44bf-a1a3-be777ba48eaa service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:52.097746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 720/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:52.957847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8326-51de-4d5d-9329-772e68ba0ffd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:52.958422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8326-51de-4d5d-9329-772e68ba0ffd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:52.958422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8326-51de-4d5d-9329-772e68ba0ffd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:52.959800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:52.965897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91607-0d86-4aa2-acf5-4519f7a76054 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:52.966630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91607-0d86-4aa2-acf5-4519f7a76054 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:52.966776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91607-0d86-4aa2-acf5-4519f7a76054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:52.989652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e5c91607-0d86-4aa2-acf5-4519f7a76054 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:52.990865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e5c91607-0d86-4aa2-acf5-4519f7a76054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:53.000307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:53.155435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8326-51de-4d5d-9329-772e68ba0ffd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:53.180352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8326-51de-4d5d-9329-772e68ba0ffd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:53.185818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c0767-7ef2-4cf0-b2e5-b09ca4049969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:53.186459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c0767-7ef2-4cf0-b2e5-b09ca4049969 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:53.186738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c0767-7ef2-4cf0-b2e5-b09ca4049969 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:53.187017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c0767-7ef2-4cf0-b2e5-b09ca4049969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:53.195805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c0767-7ef2-4cf0-b2e5-b09ca4049969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:53.197410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c0767-7ef2-4cf0-b2e5-b09ca4049969 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:53.207379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 704/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:54.075759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5aff-2227-46f1-ab7e-cee6a73ea049 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:54.076501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5aff-2227-46f1-ab7e-cee6a73ea049 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:54.076501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b5aff-2227-46f1-ab7e-cee6a73ea049 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:54.078481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:54.086368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfca39-c484-405c-bca0-0ee928beec18 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:54.086858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfca39-c484-405c-bca0-0ee928beec18 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:54.086858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfca39-c484-405c-bca0-0ee928beec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:54.108262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-44dfca39-c484-405c-bca0-0ee928beec18 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:54.109955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-44dfca39-c484-405c-bca0-0ee928beec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:54.121250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:54.286432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b5aff-2227-46f1-ab7e-cee6a73ea049 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:54.302819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b5aff-2227-46f1-ab7e-cee6a73ea049 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:54.312244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c2c5-2ece-4b8f-9ede-2e2135df2397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:54.313139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c2c5-2ece-4b8f-9ede-2e2135df2397 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:54.313440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c2c5-2ece-4b8f-9ede-2e2135df2397 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:54.313758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c2c5-2ece-4b8f-9ede-2e2135df2397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:54.326704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833c2c5-2ece-4b8f-9ede-2e2135df2397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:54.328285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833c2c5-2ece-4b8f-9ede-2e2135df2397 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:54.338778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 723/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:55.158406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911774be-dc07-4f2d-9909-b0e6b50a259a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:55.158990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911774be-dc07-4f2d-9909-b0e6b50a259a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:55.158990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911774be-dc07-4f2d-9909-b0e6b50a259a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:55.160399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:55.166643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9838c66-f7c4-4d83-bc90-18799e475195 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:55.167089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9838c66-f7c4-4d83-bc90-18799e475195 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:55.167203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9838c66-f7c4-4d83-bc90-18799e475195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:55.196018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b9838c66-f7c4-4d83-bc90-18799e475195 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:55.197252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b9838c66-f7c4-4d83-bc90-18799e475195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:55.207216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:55.359293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911774be-dc07-4f2d-9909-b0e6b50a259a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:55.378209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911774be-dc07-4f2d-9909-b0e6b50a259a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:55.384649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e1f1b-8650-4963-ad17-6f6ae238e2a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:55.385305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1f1b-8650-4963-ad17-6f6ae238e2a4 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:55.385585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1f1b-8650-4963-ad17-6f6ae238e2a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:55.385861 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1f1b-8650-4963-ad17-6f6ae238e2a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:55.394965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1f1b-8650-4963-ad17-6f6ae238e2a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:55.396711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1f1b-8650-4963-ad17-6f6ae238e2a4 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:55.406682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 707/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:56.219579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294fdf1-dfd0-4680-8c81-f0769daf9e32 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:56.220511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294fdf1-dfd0-4680-8c81-f0769daf9e32 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:56.220511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294fdf1-dfd0-4680-8c81-f0769daf9e32 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:56.222884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:56.228962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0145-4c40-4e88-89b6-acc46731954c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:56.229431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0145-4c40-4e88-89b6-acc46731954c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:56.229580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0145-4c40-4e88-89b6-acc46731954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:56.253399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6bcd0145-4c40-4e88-89b6-acc46731954c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:56.254592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6bcd0145-4c40-4e88-89b6-acc46731954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:56.263373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:56.412953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294fdf1-dfd0-4680-8c81-f0769daf9e32 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:56.430577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294fdf1-dfd0-4680-8c81-f0769daf9e32 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:56.436913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cba465-5cc7-4724-ac31-37d60c781cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:56.437561 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba465-5cc7-4724-ac31-37d60c781cb5 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:56.437844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba465-5cc7-4724-ac31-37d60c781cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:56.438102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba465-5cc7-4724-ac31-37d60c781cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:56.446614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba465-5cc7-4724-ac31-37d60c781cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:56.448250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba465-5cc7-4724-ac31-37d60c781cb5 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:56.457619 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 726/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:57.277994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044763-c275-48eb-a870-4613ac4a22f5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:57.279028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044763-c275-48eb-a870-4613ac4a22f5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:57.279028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044763-c275-48eb-a870-4613ac4a22f5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:57.281121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:57.288449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24931-e76b-4300-8737-49d19f92a1ab None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:57.288886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24931-e76b-4300-8737-49d19f92a1ab None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:57.288992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24931-e76b-4300-8737-49d19f92a1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:57.309610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-74b24931-e76b-4300-8737-49d19f92a1ab None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:57.310814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-74b24931-e76b-4300-8737-49d19f92a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:57.320318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:57.468349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044763-c275-48eb-a870-4613ac4a22f5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:57.488244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044763-c275-48eb-a870-4613ac4a22f5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:57.495199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b754-cad7-4493-9062-6d59f9974be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:57.495875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b754-cad7-4493-9062-6d59f9974be1 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:57.496162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b754-cad7-4493-9062-6d59f9974be1 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:57.496437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b754-cad7-4493-9062-6d59f9974be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:57.508350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b754-cad7-4493-9062-6d59f9974be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:57.509951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b754-cad7-4493-9062-6d59f9974be1 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:57.520221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 710/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:03:58.328047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b26dc-ad33-4b29-ae4c-dc847b66d0be None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:58.328962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b26dc-ad33-4b29-ae4c-dc847b66d0be None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:58.328962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b26dc-ad33-4b29-ae4c-dc847b66d0be None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:58.331094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:03:58.338976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bced84-4e4e-4327-b1fe-0ec59ea4902e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:58.339699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bced84-4e4e-4327-b1fe-0ec59ea4902e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:58.339938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bced84-4e4e-4327-b1fe-0ec59ea4902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:58.360705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-28bced84-4e4e-4327-b1fe-0ec59ea4902e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:03:58.361906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-28bced84-4e4e-4327-b1fe-0ec59ea4902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:03:58.370751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:03:58.522917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b26dc-ad33-4b29-ae4c-dc847b66d0be None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:03:58.549482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b26dc-ad33-4b29-ae4c-dc847b66d0be None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:03:58.557574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab712f-a525-4f10-a740-839fdfb615dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:03:58.558225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab712f-a525-4f10-a740-839fdfb615dd service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:03:58.558491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab712f-a525-4f10-a740-839fdfb615dd service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:03:58.558762 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab712f-a525-4f10-a740-839fdfb615dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:03:58.567302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab712f-a525-4f10-a740-839fdfb615dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:03:58.568918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab712f-a525-4f10-a740-839fdfb615dd service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:03:58.578652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 729/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:00.510589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093fe0-f3dd-4eca-b992-7a2f9ad0c20b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:00.511173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093fe0-f3dd-4eca-b992-7a2f9ad0c20b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:00.511173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f093fe0-f3dd-4eca-b992-7a2f9ad0c20b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:00.512581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:00.518957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbb0e-69b2-43dc-8ca4-2e29d2d0565b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:00.519718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbb0e-69b2-43dc-8ca4-2e29d2d0565b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:00.519899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbb0e-69b2-43dc-8ca4-2e29d2d0565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:00.544837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ceebbb0e-69b2-43dc-8ca4-2e29d2d0565b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:00.546060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ceebbb0e-69b2-43dc-8ca4-2e29d2d0565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:00.554400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:00.593313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f093fe0-f3dd-4eca-b992-7a2f9ad0c20b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:00.608533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f093fe0-f3dd-4eca-b992-7a2f9ad0c20b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:00.612896 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b689d8d-51fc-49cb-a106-7ef9f5b1e567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:00.613541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689d8d-51fc-49cb-a106-7ef9f5b1e567 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:00.613825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689d8d-51fc-49cb-a106-7ef9f5b1e567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:00.614096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689d8d-51fc-49cb-a106-7ef9f5b1e567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:00.624165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b689d8d-51fc-49cb-a106-7ef9f5b1e567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:00.625624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b689d8d-51fc-49cb-a106-7ef9f5b1e567 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:00.639333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 713/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:02.794120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfff72-6380-4576-b4eb-d9723c58e88e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:02.795042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfff72-6380-4576-b4eb-d9723c58e88e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:02.795042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfff72-6380-4576-b4eb-d9723c58e88e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:02.797385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:02.802891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748804-3696-4045-a536-e75e4f387df2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:02.803356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748804-3696-4045-a536-e75e4f387df2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:02.803456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748804-3696-4045-a536-e75e4f387df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:02.823033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-da748804-3696-4045-a536-e75e4f387df2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:02.824252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-da748804-3696-4045-a536-e75e4f387df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:02.832614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:02.875019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfff72-6380-4576-b4eb-d9723c58e88e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:02.894484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfff72-6380-4576-b4eb-d9723c58e88e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:02.899623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c9fa1-ace6-42e8-80f9-eb8d728488c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:02.900295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c9fa1-ace6-42e8-80f9-eb8d728488c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:02.900572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c9fa1-ace6-42e8-80f9-eb8d728488c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:02.900839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c9fa1-ace6-42e8-80f9-eb8d728488c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:02.910031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c9fa1-ace6-42e8-80f9-eb8d728488c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:02.911520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c9fa1-ace6-42e8-80f9-eb8d728488c3 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:02.920830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 732/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:05.406298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952fa8-518d-41a2-a30e-9c7901ddf28f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:05.407117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952fa8-518d-41a2-a30e-9c7901ddf28f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:05.407117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952fa8-518d-41a2-a30e-9c7901ddf28f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:05.409445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:05.414864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706ea8-3dec-4b1e-9c70-844f7a06d07c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:05.415301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706ea8-3dec-4b1e-9c70-844f7a06d07c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:05.415414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706ea8-3dec-4b1e-9c70-844f7a06d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:05.435579 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e5706ea8-3dec-4b1e-9c70-844f7a06d07c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:05.436816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e5706ea8-3dec-4b1e-9c70-844f7a06d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:05.445233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:05.486611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952fa8-518d-41a2-a30e-9c7901ddf28f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:05.498508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952fa8-518d-41a2-a30e-9c7901ddf28f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:05.502357 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b95a9-3cfb-4779-8724-0cab79f5bd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:05.502989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b95a9-3cfb-4779-8724-0cab79f5bd08 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:05.503269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b95a9-3cfb-4779-8724-0cab79f5bd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:05.503555 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b95a9-3cfb-4779-8724-0cab79f5bd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:05.513189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b95a9-3cfb-4779-8724-0cab79f5bd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:05.514626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b95a9-3cfb-4779-8724-0cab79f5bd08 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:05.524715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 716/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:07.672360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343748-b1a7-4861-88e7-2bfc8757ced3 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:07.673183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343748-b1a7-4861-88e7-2bfc8757ced3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:07.673183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343748-b1a7-4861-88e7-2bfc8757ced3 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:07.675354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:07.680925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749ac5-2c32-4948-b0fd-ff73244012b6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:07.681390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749ac5-2c32-4948-b0fd-ff73244012b6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:07.681492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749ac5-2c32-4948-b0fd-ff73244012b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:07.699533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-27749ac5-2c32-4948-b0fd-ff73244012b6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:07.700733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-27749ac5-2c32-4948-b0fd-ff73244012b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:07.708948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:07.750804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21343748-b1a7-4861-88e7-2bfc8757ced3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:07.764887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21343748-b1a7-4861-88e7-2bfc8757ced3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:07.769219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce625e4-77df-4c27-9967-a1bf09ff54e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:07.769864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce625e4-77df-4c27-9967-a1bf09ff54e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:07.770147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce625e4-77df-4c27-9967-a1bf09ff54e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:07.770428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce625e4-77df-4c27-9967-a1bf09ff54e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:07.779838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce625e4-77df-4c27-9967-a1bf09ff54e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:07.781308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce625e4-77df-4c27-9967-a1bf09ff54e2 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:07.790935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 735/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:09.897890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e07f-60ba-4ed5-b73c-0a9f828afe3c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:09.898508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e07f-60ba-4ed5-b73c-0a9f828afe3c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:09.898508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e07f-60ba-4ed5-b73c-0a9f828afe3c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:09.899798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:09.908625 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7b8c-481f-4038-b16e-882d93500466 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:09.909379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7b8c-481f-4038-b16e-882d93500466 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:09.909549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7b8c-481f-4038-b16e-882d93500466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:09.935042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bc8f7b8c-481f-4038-b16e-882d93500466 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:09.936253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bc8f7b8c-481f-4038-b16e-882d93500466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:09.945588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:09.986742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e07f-60ba-4ed5-b73c-0a9f828afe3c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:10.000075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7e07f-60ba-4ed5-b73c-0a9f828afe3c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:10.004295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b82c8-96b9-4b9e-8f0f-af23b20cbd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:10.005013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b82c8-96b9-4b9e-8f0f-af23b20cbd20 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:10.005292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b82c8-96b9-4b9e-8f0f-af23b20cbd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:10.005549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b82c8-96b9-4b9e-8f0f-af23b20cbd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:10.014758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b82c8-96b9-4b9e-8f0f-af23b20cbd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:10.016230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b82c8-96b9-4b9e-8f0f-af23b20cbd20 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:10.025695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 719/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:12.058970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8a3b-ddc6-4b76-9586-c4c16e54c72f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:12.059549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8a3b-ddc6-4b76-9586-c4c16e54c72f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:12.059549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8a3b-ddc6-4b76-9586-c4c16e54c72f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:12.060935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:12.067328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc39c16-aeb1-46fe-9421-2769cc18b782 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:12.068079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc39c16-aeb1-46fe-9421-2769cc18b782 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:12.068283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc39c16-aeb1-46fe-9421-2769cc18b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:12.092777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1fc39c16-aeb1-46fe-9421-2769cc18b782 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:12.093958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1fc39c16-aeb1-46fe-9421-2769cc18b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:12.102084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:12.139745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e8a3b-ddc6-4b76-9586-c4c16e54c72f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:12.151212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e8a3b-ddc6-4b76-9586-c4c16e54c72f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:12.155267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbd9df-95d0-44e9-a245-f159abfee95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:12.155895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbd9df-95d0-44e9-a245-f159abfee95d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:12.156203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbd9df-95d0-44e9-a245-f159abfee95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:12.156452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbd9df-95d0-44e9-a245-f159abfee95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:12.165798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbd9df-95d0-44e9-a245-f159abfee95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:12.167254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbd9df-95d0-44e9-a245-f159abfee95d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:12.177108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 738/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:04:14.272068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11451-7b08-436e-988d-eed290742f0e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:14.272678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11451-7b08-436e-988d-eed290742f0e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:14.272678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11451-7b08-436e-988d-eed290742f0e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:14.274011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:14.280407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662b6f-dab9-48b5-8c9c-7961a8fd7c0c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:14.281142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662b6f-dab9-48b5-8c9c-7961a8fd7c0c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:14.281305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662b6f-dab9-48b5-8c9c-7961a8fd7c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:14.305272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1f662b6f-dab9-48b5-8c9c-7961a8fd7c0c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:14.306470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1f662b6f-dab9-48b5-8c9c-7961a8fd7c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:14.314842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:14.356385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f11451-7b08-436e-988d-eed290742f0e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:14.371405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f11451-7b08-436e-988d-eed290742f0e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:14.375458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a52d7c-88c4-4d92-930e-21caa4ed93f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:14.376148 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52d7c-88c4-4d92-930e-21caa4ed93f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:14.376426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52d7c-88c4-4d92-930e-21caa4ed93f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:14.376703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52d7c-88c4-4d92-930e-21caa4ed93f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:14.387233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a52d7c-88c4-4d92-930e-21caa4ed93f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:14.388698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a52d7c-88c4-4d92-930e-21caa4ed93f6 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:14.398307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 722/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:16.473187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704e17-e0cd-4b50-9eb2-5ec3ec828133 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:16.473785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704e17-e0cd-4b50-9eb2-5ec3ec828133 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:16.473785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704e17-e0cd-4b50-9eb2-5ec3ec828133 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:16.475167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:16.481711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3d72-e45d-4547-a395-5a88901554b6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:16.482377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3d72-e45d-4547-a395-5a88901554b6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:16.482534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3d72-e45d-4547-a395-5a88901554b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:16.491596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=79 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:04:16.504930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f45a3d72-e45d-4547-a395-5a88901554b6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:16.506132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f45a3d72-e45d-4547-a395-5a88901554b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:16.514920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:16.552586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b704e17-e0cd-4b50-9eb2-5ec3ec828133 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:16.558654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=73 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:04:16.565961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b704e17-e0cd-4b50-9eb2-5ec3ec828133 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:16.569914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af79a2c-9d6f-469b-92fc-3d1ae92fe1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:16.570559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af79a2c-9d6f-469b-92fc-3d1ae92fe1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:16.570843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af79a2c-9d6f-469b-92fc-3d1ae92fe1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:16.571106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af79a2c-9d6f-469b-92fc-3d1ae92fe1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:16.580918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af79a2c-9d6f-469b-92fc-3d1ae92fe1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:16.582363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af79a2c-9d6f-469b-92fc-3d1ae92fe1f1 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:16.592008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 741/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:18.605888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803232e7-b651-46b1-93d7-90b127a2a7f8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:18.606424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803232e7-b651-46b1-93d7-90b127a2a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:18.606424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803232e7-b651-46b1-93d7-90b127a2a7f8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:18.607699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:18.614303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7bb6-99ff-467b-a8a2-5a808cff2159 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:18.614727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7bb6-99ff-467b-a8a2-5a808cff2159 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:18.614851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7bb6-99ff-467b-a8a2-5a808cff2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:18.633969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a22c7bb6-99ff-467b-a8a2-5a808cff2159 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:18.635189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a22c7bb6-99ff-467b-a8a2-5a808cff2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:18.643720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:18.680461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803232e7-b651-46b1-93d7-90b127a2a7f8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:18.692467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803232e7-b651-46b1-93d7-90b127a2a7f8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:18.696565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95df19-2656-4c53-890f-2936642cb25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:18.697199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95df19-2656-4c53-890f-2936642cb25c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:18.697478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95df19-2656-4c53-890f-2936642cb25c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:18.697755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95df19-2656-4c53-890f-2936642cb25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:18.707198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95df19-2656-4c53-890f-2936642cb25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:18.708702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95df19-2656-4c53-890f-2936642cb25c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:18.718386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 725/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:20.751669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b2459-5193-4d69-b865-ecf8ed68c75f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:20.752582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b2459-5193-4d69-b865-ecf8ed68c75f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:20.752582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b2459-5193-4d69-b865-ecf8ed68c75f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:20.755014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:04:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:20.760705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce4924-f0b5-4bd4-97da-7370fae998bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:20.761196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce4924-f0b5-4bd4-97da-7370fae998bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:20.761196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce4924-f0b5-4bd4-97da-7370fae998bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:20.779463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bfce4924-f0b5-4bd4-97da-7370fae998bf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:20.780677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bfce4924-f0b5-4bd4-97da-7370fae998bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:20.789293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:20.827943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b2459-5193-4d69-b865-ecf8ed68c75f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:20.840511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b2459-5193-4d69-b865-ecf8ed68c75f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:20.844921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e09037-f077-4f69-8c02-169879fd648e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:20.845574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e09037-f077-4f69-8c02-169879fd648e service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:20.845855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e09037-f077-4f69-8c02-169879fd648e service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:20.846129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e09037-f077-4f69-8c02-169879fd648e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:20.856813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e09037-f077-4f69-8c02-169879fd648e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:20.858147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e09037-f077-4f69-8c02-169879fd648e service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:20.868169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 744/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:04:30.774377 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=11 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:04:30.863578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=14 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:04:40.474910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c4129-b02c-4101-bb44-6dd5bc48048d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:40.475504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c4129-b02c-4101-bb44-6dd5bc48048d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:40.475504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c4129-b02c-4101-bb44-6dd5bc48048d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:40.477730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 727/1471] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:40.486577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cef0b-a640-4eaa-817c-164100aae3b5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:40.487082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cef0b-a640-4eaa-817c-164100aae3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:40.487082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cef0b-a640-4eaa-817c-164100aae3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:40.505374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-957cef0b-a640-4eaa-817c-164100aae3b5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:40.506571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-957cef0b-a640-4eaa-817c-164100aae3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:40.514941 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 745/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:40.562219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39266e-01dd-4ac5-88de-ef7bd6519986 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:40.562506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39266e-01dd-4ac5-88de-ef7bd6519986 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:40.562808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39266e-01dd-4ac5-88de-ef7bd6519986 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:40.564223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 728/1473] 10.222.0.27 () {54 vars in 962 bytes} [Fri Jun 24 07:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:40.569016 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6c0ce-1ccc-4d90-b27c-3fc1578070df None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:40.569306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6c0ce-1ccc-4d90-b27c-3fc1578070df None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:40.569587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6c0ce-1ccc-4d90-b27c-3fc1578070df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:40.587838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-63b6c0ce-1ccc-4d90-b27c-3fc1578070df None None] MFA Rules not processed for user `d928c6bee9f744c082c98811fcb35629`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:40.589046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63b6c0ce-1ccc-4d90-b27c-3fc1578070df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:40.595885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 746/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Jun 24 07:04:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:40.603037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39266e-01dd-4ac5-88de-ef7bd6519986 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:40.614983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39266e-01dd-4ac5-88de-ef7bd6519986 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:40.618898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d1ba5-3809-4a18-926e-a18c21841c73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:40.619459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1ba5-3809-4a18-926e-a18c21841c73 service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:40.619733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1ba5-3809-4a18-926e-a18c21841c73 service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:40.620043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1ba5-3809-4a18-926e-a18c21841c73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:40.629727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1ba5-3809-4a18-926e-a18c21841c73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:40.631144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1ba5-3809-4a18-926e-a18c21841c73 service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:40.640702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 729/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:42.764048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457a60-9c9c-436b-9b26-49094055d5f4 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:42.764590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457a60-9c9c-436b-9b26-49094055d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:42.764590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457a60-9c9c-436b-9b26-49094055d5f4 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:42.766654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 747/1476] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:42.773338 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58fec-3bdb-4e57-ab93-df250814eac6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:42.773835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58fec-3bdb-4e57-ab93-df250814eac6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:42.773835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58fec-3bdb-4e57-ab93-df250814eac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:42.793320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4ce58fec-3bdb-4e57-ab93-df250814eac6 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:42.794494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4ce58fec-3bdb-4e57-ab93-df250814eac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:42.803622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 730/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:04:42.826808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457a60-9c9c-436b-9b26-49094055d5f4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:42.841098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457a60-9c9c-436b-9b26-49094055d5f4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:42.846706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:42.847342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:42.847640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:42.847944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:42.848675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:42.850431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:04:42.850431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:04:42.850431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:04:42.851574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8d7ce-3231-4a63-9738-31d693d9f389 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:42.871628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 748/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jun 24 07:04:42 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:04:44.928496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c8026-6e11-48ea-b844-4d9a3201ad22 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:44.929344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c8026-6e11-48ea-b844-4d9a3201ad22 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:44.929344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c8026-6e11-48ea-b844-4d9a3201ad22 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:44.931524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 731/1479] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:44.937980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca1e6-d985-4507-876d-979c12b1554c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:44.938680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca1e6-d985-4507-876d-979c12b1554c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:44.938864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca1e6-d985-4507-876d-979c12b1554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:44.963548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-735ca1e6-d985-4507-876d-979c12b1554c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:44.964782 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-735ca1e6-d985-4507-876d-979c12b1554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:44.974450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 749/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:45.023611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c8026-6e11-48ea-b844-4d9a3201ad22 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:45.048812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c8026-6e11-48ea-b844-4d9a3201ad22 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:45.056032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dea2e2-11a6-4d46-926c-089167512dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:45.056674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea2e2-11a6-4d46-926c-089167512dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:45.056950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea2e2-11a6-4d46-926c-089167512dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:45.057216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dea2e2-11a6-4d46-926c-089167512dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:45.066503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dea2e2-11a6-4d46-926c-089167512dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:45.068187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dea2e2-11a6-4d46-926c-089167512dc2 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:45.077876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 732/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:47.256818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982760f-54b5-44b9-a2bf-16d099a76c54 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:47.257722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982760f-54b5-44b9-a2bf-16d099a76c54 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:47.257722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982760f-54b5-44b9-a2bf-16d099a76c54 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:47.259800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 750/1482] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:47.268504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41116-050f-49b1-ad78-3dc0505fd48d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:47.268950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41116-050f-49b1-ad78-3dc0505fd48d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:47.269067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41116-050f-49b1-ad78-3dc0505fd48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:47.287233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5dc41116-050f-49b1-ad78-3dc0505fd48d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:47.288453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5dc41116-050f-49b1-ad78-3dc0505fd48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:47.297318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 733/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:47.333533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982760f-54b5-44b9-a2bf-16d099a76c54 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:47.352299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982760f-54b5-44b9-a2bf-16d099a76c54 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:47.359485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097bcd2-154e-4bb6-a917-a66c6f6ad5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:47.360469 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097bcd2-154e-4bb6-a917-a66c6f6ad5bf service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:47.360793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097bcd2-154e-4bb6-a917-a66c6f6ad5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:47.361156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097bcd2-154e-4bb6-a917-a66c6f6ad5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:47.371697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097bcd2-154e-4bb6-a917-a66c6f6ad5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:47.373174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097bcd2-154e-4bb6-a917-a66c6f6ad5bf service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:47.383020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 751/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:49.461759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78287793-ea5b-420c-95cb-f57329293da6 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:49.462602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78287793-ea5b-420c-95cb-f57329293da6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:49.462602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78287793-ea5b-420c-95cb-f57329293da6 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:49.464914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 734/1485] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:49.471383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede233dc-613f-48ac-a9b0-a89b4570ebc3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:49.471878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede233dc-613f-48ac-a9b0-a89b4570ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:49.471980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede233dc-613f-48ac-a9b0-a89b4570ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:49.498066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ede233dc-613f-48ac-a9b0-a89b4570ebc3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:49.499263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ede233dc-613f-48ac-a9b0-a89b4570ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:49.509166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 752/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:49.552917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78287793-ea5b-420c-95cb-f57329293da6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:49.565678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78287793-ea5b-420c-95cb-f57329293da6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:49.570044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def13835-d144-413e-a211-607c1a650e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:49.570670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13835-d144-413e-a211-607c1a650e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:49.570946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13835-d144-413e-a211-607c1a650e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:49.571244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def13835-d144-413e-a211-607c1a650e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:49.581466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13835-d144-413e-a211-607c1a650e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:49.582966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def13835-d144-413e-a211-607c1a650e98 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:49.592574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 735/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:51.832156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3730b-2700-4eb3-b180-80b9342d0aa9 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:51.833080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3730b-2700-4eb3-b180-80b9342d0aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:51.833080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3730b-2700-4eb3-b180-80b9342d0aa9 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:51.835187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 753/1488] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:51.841780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b822ae-1ee5-4cf5-90b2-248725dba6ef None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:51.842220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b822ae-1ee5-4cf5-90b2-248725dba6ef None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:51.842329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b822ae-1ee5-4cf5-90b2-248725dba6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:51.869446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-75b822ae-1ee5-4cf5-90b2-248725dba6ef None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:51.870669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-75b822ae-1ee5-4cf5-90b2-248725dba6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:51.881160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 736/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:51.921740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3730b-2700-4eb3-b180-80b9342d0aa9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:51.933750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3730b-2700-4eb3-b180-80b9342d0aa9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:51.937798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185328f-81d0-48f3-b8e6-201267cab3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:51.938447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185328f-81d0-48f3-b8e6-201267cab3ec service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:51.938729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185328f-81d0-48f3-b8e6-201267cab3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:51.939007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185328f-81d0-48f3-b8e6-201267cab3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:51.948265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185328f-81d0-48f3-b8e6-201267cab3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:51.949712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185328f-81d0-48f3-b8e6-201267cab3ec service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:51.959571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 754/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:04:54.169519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa05b9-c914-440a-9bed-1496dca1c143 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:54.170120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa05b9-c914-440a-9bed-1496dca1c143 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:54.170120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa05b9-c914-440a-9bed-1496dca1c143 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:54.171440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 737/1491] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jun 24 07:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:04:54.178232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9f5c-98fd-497f-a5cd-54adaa1aa718 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:54.178968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9f5c-98fd-497f-a5cd-54adaa1aa718 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:54.179159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9f5c-98fd-497f-a5cd-54adaa1aa718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:54.208913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-313f9f5c-98fd-497f-a5cd-54adaa1aa718 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:04:54.210121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-313f9f5c-98fd-497f-a5cd-54adaa1aa718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:04:54.219533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 755/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jun 24 07:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:04:54.263084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa05b9-c914-440a-9bed-1496dca1c143 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:04:54.282008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa05b9-c914-440a-9bed-1496dca1c143 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:04:54.287372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b342f-8589-46d0-9a3b-57e68a8b4dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:04:54.288052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b342f-8589-46d0-9a3b-57e68a8b4dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:04:54.288331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b342f-8589-46d0-9a3b-57e68a8b4dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:04:54.288608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b342f-8589-46d0-9a3b-57e68a8b4dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:04:54.299000 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b342f-8589-46d0-9a3b-57e68a8b4dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:04:54.300471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b342f-8589-46d0-9a3b-57e68a8b4dcb service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:04:54.311615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 738/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:05:04.201030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=33 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:05:04.306094 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=33 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:06:18.768386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:18.769249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:18.769249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:18.791117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:06:18.792410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:18.801163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 756/1494] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:06:18.810604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:18.811126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:18.811126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:18.830519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:06:18.831699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:18.841138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 739/1495] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:06:18.845733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:18.856292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ff2f4-10c5-4e7f-8b17-29bbd83bc7db None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:18.862317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:18.862962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:18.863238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:18.863503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:18.864292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:06:18.864592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:18.865597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:18.865597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:06:18.865597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:06:18.866541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:18.878501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 757/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:06:18.886412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:18.896330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f298b-2c29-46e2-a418-e51a21139e0b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:18.902404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:18.903071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:18.903355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:18.903608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:18.904354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:18.906067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:18.906067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:06:18.906067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:06:18.907261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:18.951716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 740/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:06:18 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:06:18.956263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:18.966693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b982bd-620e-4e6e-acc7-30f31d5b0ea7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.025063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.025721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.026004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.026276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.026957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.027997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:19.027997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:06:19.027997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:06:19.029243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.051396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 758/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:06:18 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:06:19.055585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:19.066436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525127b4-f182-40d1-a650-5895e81c3ee8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.071086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.071736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.072037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.072309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.073029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.074032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:19.074032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:06:19.074032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:06:19.074926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.087516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 741/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:06:19.091717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:19.102406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9cee4-26ee-40c8-bc19-e7c87a19acfb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.108448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.109112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.109392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.109662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.110387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.111366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:19.111366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:06:19.111366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:06:19.112295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da55c-8ed3-4913-ba10-5910b446ff44 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.127121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 759/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:06:19.131356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:19.141140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f6f8a-d389-4c05-91af-5cbe668204af admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.146488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.147375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.147649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.147954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] PATH_INFO: `/v3/projects/560a482c581e40c681025ba9e63a40d2/users/1929db9fce1d461088d8a746f83ec0c5/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.163786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=560a482c581e40c681025ba9e63a40d2, user_id=1929db9fce1d461088d8a746f83ec0c5, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.164849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:19.164849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:06:19.164849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:06:19.166796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54915146-fe85-4fa0-974d-1e79b04b9d9a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.181012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 742/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:06:19 2022] PUT /identity/v3/projects/560a482c581e40c681025ba9e63a40d2/users/1929db9fce1d461088d8a746f83ec0c5/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:06:19.193120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27cdb-ab43-45b3-accc-b09f3d8d2594 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.193419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27cdb-ab43-45b3-accc-b09f3d8d2594 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.193699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27cdb-ab43-45b3-accc-b09f3d8d2594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.219962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ccc27cdb-ab43-45b3-accc-b09f3d8d2594 None None] MFA Rules not processed for user `1929db9fce1d461088d8a746f83ec0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:06:19.221149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ccc27cdb-ab43-45b3-accc-b09f3d8d2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:19.286994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 760/1502] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:06:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:06:19.301747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4b410-d733-4319-9420-4f2f3bd92649 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.302192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4b410-d733-4319-9420-4f2f3bd92649 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.302633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4b410-d733-4319-9420-4f2f3bd92649 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.304792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 743/1503] 10.222.0.27 () {54 vars in 963 bytes} [Fri Jun 24 07:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:06:19.310396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef48751-e21f-4f58-bc8b-4afd9215cebc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.310777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef48751-e21f-4f58-bc8b-4afd9215cebc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.311131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef48751-e21f-4f58-bc8b-4afd9215cebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.330572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-eef48751-e21f-4f58-bc8b-4afd9215cebc None None] MFA Rules not processed for user `4530cddbad6f4446beaf33a67135257e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:06:19.331759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-eef48751-e21f-4f58-bc8b-4afd9215cebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:19.377860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:06:19.388061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 761/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Fri Jun 24 07:06:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:06:19.396707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4b410-d733-4319-9420-4f2f3bd92649 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:19.407936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4b410-d733-4319-9420-4f2f3bd92649 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.412496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.413475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.413749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.414016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.425519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.427253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.437496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 744/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:06:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:06:19.482892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324abe8-f2d3-448f-b360-c0536e1f5b08 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.483182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324abe8-f2d3-448f-b360-c0536e1f5b08 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.483461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324abe8-f2d3-448f-b360-c0536e1f5b08 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.484817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 762/1506] 10.222.0.27 () {52 vars in 829 bytes} [Fri Jun 24 07:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:06:19.489336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:19.555429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffcca5-24f6-45fb-a06c-755d2f64b2b3 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.561058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.561933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.562207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.562474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] PATH_INFO: `/v3/users/1929db9fce1d461088d8a746f83ec0c5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.564033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1929db9fce1d461088d8a746f83ec0c5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.565057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:19.565057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:06:19.565057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:06:19.566254 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.634467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1929db9fce1d461088d8a746f83ec0c5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:19.652273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1929db9fce1d461088d8a746f83ec0c5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:19.663824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1929db9fce1d461088d8a746f83ec0c5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:19.664592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1929db9fce1d461088d8a746f83ec0c5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:19.665739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1929db9fce1d461088d8a746f83ec0c5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:19.674918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:06:19.685082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 745/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:06:19 2022] DELETE /identity/v3/users/1929db9fce1d461088d8a746f83ec0c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:06:19.690539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.690933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.691365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.713466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:06:19.714671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:19.782253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 763/1508] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:06:19.792143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:19.794362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:19.852343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224965-251e-4217-8466-12b986e3c9a3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:19.856495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626a741-5cc0-426b-b631-52bee48093b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:19.857152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a741-5cc0-426b-b631-52bee48093b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:19.857430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a741-5cc0-426b-b631-52bee48093b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:19.857724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a741-5cc0-426b-b631-52bee48093b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:19.866930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626a741-5cc0-426b-b631-52bee48093b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:19.868404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626a741-5cc0-426b-b631-52bee48093b7 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:19.877898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 746/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:06:20.239956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:06:20.241663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:06:20.254735 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9e353-44d2-4c4d-80d3-92810294ecaf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:06:20.260256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:06:20.261148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:06:20.261431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:06:20.261706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] PATH_INFO: `/v3/projects/560a482c581e40c681025ba9e63a40d2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:06:20.262989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=560a482c581e40c681025ba9e63a40d2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:06:20.264104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:06:20.264104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:06:20.264104 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:06:20.265313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:06:20.345015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560a482c581e40c681025ba9e63a40d2', 'request_id': 'req-80c29be4-9f56-4128-a34a-05575a71d39e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:20.358922 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560a482c581e40c681025ba9e63a40d2', 'request_id': 'req-80c29be4-9f56-4128-a34a-05575a71d39e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:20.365312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560a482c581e40c681025ba9e63a40d2', 'request_id': 'req-80c29be4-9f56-4128-a34a-05575a71d39e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:20.382731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] The token cache is being invalidate because project 560a482c581e40c681025ba9e63a40d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:06:20.383156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:20.386286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-80c29be4-9f56-4128-a34a-05575a71d39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:06:20.389065 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 764/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:06:20 2022] DELETE /identity/v3/projects/560a482c581e40c681025ba9e63a40d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:06:29.873625 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=29 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:06:30.377669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:07:52.213529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a8ee8-adb8-4a20-9bec-2c25fff0acf3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:52.214111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a8ee8-adb8-4a20-9bec-2c25fff0acf3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:52.214111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a8ee8-adb8-4a20-9bec-2c25fff0acf3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:52.215426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:07:52.221433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d61c0-cb28-4e3d-990f-a2760837e338 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:52.221902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d61c0-cb28-4e3d-990f-a2760837e338 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:52.222003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d61c0-cb28-4e3d-990f-a2760837e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:52.243495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-697d61c0-cb28-4e3d-990f-a2760837e338 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:07:52.244958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-697d61c0-cb28-4e3d-990f-a2760837e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:07:52.313174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:07:52.471565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a8ee8-adb8-4a20-9bec-2c25fff0acf3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:07:52.473588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8b8a8ee8-adb8-4a20-9bec-2c25fff0acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:07:52.564638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a8ee8-adb8-4a20-9bec-2c25fff0acf3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:07:52.570812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63e13b-79d9-4c68-8529-e55279dc90f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:07:52.571458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63e13b-79d9-4c68-8529-e55279dc90f8 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:52.571736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63e13b-79d9-4c68-8529-e55279dc90f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:52.572038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63e13b-79d9-4c68-8529-e55279dc90f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:52.581323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63e13b-79d9-4c68-8529-e55279dc90f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:07:52.583307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63e13b-79d9-4c68-8529-e55279dc90f8 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:07:52.593510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 748/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:07:53.504077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfe33-00df-49c1-9f89-77aa597cc44d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:53.504707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfe33-00df-49c1-9f89-77aa597cc44d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:53.504707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfe33-00df-49c1-9f89-77aa597cc44d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:53.506205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:07:53.512543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc592-4c2a-4c2a-8633-778a5ba40359 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:53.513319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc592-4c2a-4c2a-8633-778a5ba40359 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:53.513471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc592-4c2a-4c2a-8633-778a5ba40359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:53.537050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-87ecc592-4c2a-4c2a-8633-778a5ba40359 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:07:53.538599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-87ecc592-4c2a-4c2a-8633-778a5ba40359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:07:53.547744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:07:53.709864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfe33-00df-49c1-9f89-77aa597cc44d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:07:53.724900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfe33-00df-49c1-9f89-77aa597cc44d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:07:53.731663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ff688-88f7-40be-b2d0-6f899ef51b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:07:53.732369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ff688-88f7-40be-b2d0-6f899ef51b46 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:53.732644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ff688-88f7-40be-b2d0-6f899ef51b46 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:53.732916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ff688-88f7-40be-b2d0-6f899ef51b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:53.741227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ff688-88f7-40be-b2d0-6f899ef51b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:07:53.742833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ff688-88f7-40be-b2d0-6f899ef51b46 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:07:53.752115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 767/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:07:54.183839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17bf8c-c681-4288-9423-bc747c73b005 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:54.184118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17bf8c-c681-4288-9423-bc747c73b005 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:54.184427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17bf8c-c681-4288-9423-bc747c73b005 None None] PATH_INFO: `/v3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:54.185764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 750/1517] 10.222.0.20 () {54 vars in 925 bytes} [Fri Jun 24 07:07:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:07:54.191956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1426ea-9cec-4d35-abc9-f07960f2919e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:54.192274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1426ea-9cec-4d35-abc9-f07960f2919e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:54.192546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1426ea-9cec-4d35-abc9-f07960f2919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:54.214936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2b1426ea-9cec-4d35-abc9-f07960f2919e None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:07:54.216175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2b1426ea-9cec-4d35-abc9-f07960f2919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:07:54.295681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 768/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Jun 24 07:07:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:07:58.072922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe486-4aa9-4405-be45-7dde0b5d18ce None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:58.073480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe486-4aa9-4405-be45-7dde0b5d18ce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:58.073480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe486-4aa9-4405-be45-7dde0b5d18ce None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:58.074886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 751/1519] 10.222.0.27 () {54 vars in 960 bytes} [Fri Jun 24 07:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:07:58.082746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c39a2-6efc-4365-930f-054f696a87fa None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:58.083249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c39a2-6efc-4365-930f-054f696a87fa None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:58.083384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c39a2-6efc-4365-930f-054f696a87fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:58.102580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d97c39a2-6efc-4365-930f-054f696a87fa None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:07:58.104137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d97c39a2-6efc-4365-930f-054f696a87fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:07:58.113912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 769/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Fri Jun 24 07:07:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:07:58.125482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfe486-4aa9-4405-be45-7dde0b5d18ce None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:07:58.140103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfe486-4aa9-4405-be45-7dde0b5d18ce None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:07:58.145383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081ca7a-e7fe-41a9-8467-72b9dff82185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6637a4d8b7104d158d4d9952cc2a5216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:07:58.146081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081ca7a-e7fe-41a9-8467-72b9dff82185 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:07:58.146365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081ca7a-e7fe-41a9-8467-72b9dff82185 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:07:58.146643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081ca7a-e7fe-41a9-8467-72b9dff82185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:07:58.155372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081ca7a-e7fe-41a9-8467-72b9dff82185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:07:58.157103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081ca7a-e7fe-41a9-8467-72b9dff82185 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:07:58.167131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 752/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:07:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:04.979515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b868-931e-46f6-828d-b813b3a3c4b2 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:04.980068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b868-931e-46f6-828d-b813b3a3c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:04.980068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b868-931e-46f6-828d-b813b3a3c4b2 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:04.981477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:08:04.987234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4a52-07a3-495b-8691-4aebca5ec2be None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:04.987964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4a52-07a3-495b-8691-4aebca5ec2be None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:04.988079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4a52-07a3-495b-8691-4aebca5ec2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:05.009028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f3df4a52-07a3-495b-8691-4aebca5ec2be None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:08:05.010234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f3df4a52-07a3-495b-8691-4aebca5ec2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:05.018751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:08:05.178249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b868-931e-46f6-828d-b813b3a3c4b2 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:08:05.204011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b868-931e-46f6-828d-b813b3a3c4b2 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:08:05.209616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50325ea4-c8a4-43cb-aaaa-737bae463d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:08:05.210256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50325ea4-c8a4-43cb-aaaa-737bae463d4e service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:05.210537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50325ea4-c8a4-43cb-aaaa-737bae463d4e service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:05.210811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50325ea4-c8a4-43cb-aaaa-737bae463d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:05.220425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50325ea4-c8a4-43cb-aaaa-737bae463d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:08:05.222124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50325ea4-c8a4-43cb-aaaa-737bae463d4e service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:08:05.232221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 771/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:06.061262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e8cb-8b38-4d0d-b039-91e4711f566c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:06.062172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e8cb-8b38-4d0d-b039-91e4711f566c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:06.062172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e8cb-8b38-4d0d-b039-91e4711f566c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:06.064356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 07:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:08:06.071826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92d05-a4f4-4bbe-9fd7-8331836dc67b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:06.072254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92d05-a4f4-4bbe-9fd7-8331836dc67b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:06.072417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92d05-a4f4-4bbe-9fd7-8331836dc67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:06.091730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-84c92d05-a4f4-4bbe-9fd7-8331836dc67b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:08:06.093105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-84c92d05-a4f4-4bbe-9fd7-8331836dc67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:06.101982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 07:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:08:06.258735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241e8cb-8b38-4d0d-b039-91e4711f566c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:08:06.276398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241e8cb-8b38-4d0d-b039-91e4711f566c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:08:06.283225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b0c8a-0f29-4aa8-aa54-5f281e4818d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:08:06.283873 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b0c8a-0f29-4aa8-aa54-5f281e4818d8 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:06.284181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b0c8a-0f29-4aa8-aa54-5f281e4818d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:06.284452 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b0c8a-0f29-4aa8-aa54-5f281e4818d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:06.293739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b0c8a-0f29-4aa8-aa54-5f281e4818d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:08:06.295337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b0c8a-0f29-4aa8-aa54-5f281e4818d8 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:08:06.305345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 755/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:10.227547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8d93-88ea-4225-9128-7c5482a9b4af None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:10.228501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8d93-88ea-4225-9128-7c5482a9b4af None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:10.228501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8d93-88ea-4225-9128-7c5482a9b4af None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:10.229823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:08:10.236325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d2c49-3d9a-4041-8237-5404417c23a4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:10.236774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d2c49-3d9a-4041-8237-5404417c23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:10.236877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d2c49-3d9a-4041-8237-5404417c23a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:10.257932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5d1d2c49-3d9a-4041-8237-5404417c23a4 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:08:10.259131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5d1d2c49-3d9a-4041-8237-5404417c23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:10.268199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:08:10.309744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d8d93-88ea-4225-9128-7c5482a9b4af None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:08:10.312977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-442d8d93-88ea-4225-9128-7c5482a9b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:10.376085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d8d93-88ea-4225-9128-7c5482a9b4af None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:08:10.379990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff743efa-82cd-4aba-8e4b-b09d3d577a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:08:10.380727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743efa-82cd-4aba-8e4b-b09d3d577a3f service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:10.381004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743efa-82cd-4aba-8e4b-b09d3d577a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:10.381275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743efa-82cd-4aba-8e4b-b09d3d577a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:10.390773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff743efa-82cd-4aba-8e4b-b09d3d577a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:08:10.392237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff743efa-82cd-4aba-8e4b-b09d3d577a3f service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:08:10.397066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:08:10.402490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 774/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:12.421492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fe92-3d43-4196-a29d-9bf87533efc9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:12.422087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fe92-3d43-4196-a29d-9bf87533efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:12.422087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fe92-3d43-4196-a29d-9bf87533efc9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:12.423439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:08:12.429908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d46a-3b7b-4d5d-8d7a-247086859595 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:12.430378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d46a-3b7b-4d5d-8d7a-247086859595 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:12.430478 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d46a-3b7b-4d5d-8d7a-247086859595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:12.449865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9620d46a-3b7b-4d5d-8d7a-247086859595 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:08:12.451082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9620d46a-3b7b-4d5d-8d7a-247086859595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:12.460304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:08:12.498032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fe92-3d43-4196-a29d-9bf87533efc9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:08:12.512815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fe92-3d43-4196-a29d-9bf87533efc9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:08:12.517068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87706-1eb9-4a11-abd5-cfbaa2d763e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:08:12.517707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87706-1eb9-4a11-abd5-cfbaa2d763e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:12.517996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87706-1eb9-4a11-abd5-cfbaa2d763e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:12.518271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87706-1eb9-4a11-abd5-cfbaa2d763e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:12.528621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca87706-1eb9-4a11-abd5-cfbaa2d763e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:08:12.530109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca87706-1eb9-4a11-abd5-cfbaa2d763e3 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:08:12.540207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 758/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:16.079811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aff5-808c-4d59-a9c4-e3d646801da5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:16.080680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aff5-808c-4d59-a9c4-e3d646801da5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:16.080680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aff5-808c-4d59-a9c4-e3d646801da5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:16.082909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:08:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:08:16.088500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3176-0815-47f2-a93f-0400fc0337ae None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:16.088961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3176-0815-47f2-a93f-0400fc0337ae None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:16.089064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3176-0815-47f2-a93f-0400fc0337ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:16.110097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b25d3176-0815-47f2-a93f-0400fc0337ae None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:08:16.111564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b25d3176-0815-47f2-a93f-0400fc0337ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:16.121543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:08:16.423951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828aff5-808c-4d59-a9c4-e3d646801da5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:08:16.426010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0828aff5-808c-4d59-a9c4-e3d646801da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:16.489208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828aff5-808c-4d59-a9c4-e3d646801da5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:08:16.496107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86bcc8-b1f3-4e7b-82f5-21113c6c33e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:08:16.497072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bcc8-b1f3-4e7b-82f5-21113c6c33e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:16.497471 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bcc8-b1f3-4e7b-82f5-21113c6c33e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:16.497873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bcc8-b1f3-4e7b-82f5-21113c6c33e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:16.510499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86bcc8-b1f3-4e7b-82f5-21113c6c33e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:08:16.511998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86bcc8-b1f3-4e7b-82f5-21113c6c33e3 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:08:16.522875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 777/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:18.560889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26977c7-ce9d-4c96-94f0-98a9327b387b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:18.561783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26977c7-ce9d-4c96-94f0-98a9327b387b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:18.561783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26977c7-ce9d-4c96-94f0-98a9327b387b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:18.564062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 07:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:08:18.572539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8493-f1f1-4d63-85e9-86dfaeeb0c04 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:18.572965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8493-f1f1-4d63-85e9-86dfaeeb0c04 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:18.573090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8493-f1f1-4d63-85e9-86dfaeeb0c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:18.592268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2b4a8493-f1f1-4d63-85e9-86dfaeeb0c04 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:08:18.593464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2b4a8493-f1f1-4d63-85e9-86dfaeeb0c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:18.602366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 07:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:08:18.902960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26977c7-ce9d-4c96-94f0-98a9327b387b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:08:18.905818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d26977c7-ce9d-4c96-94f0-98a9327b387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:08:18.921640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26977c7-ce9d-4c96-94f0-98a9327b387b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:08:18.925550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9f579-c76c-428b-a312-d177ee5fbfe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:08:18.926185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9f579-c76c-428b-a312-d177ee5fbfe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:08:18.926465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9f579-c76c-428b-a312-d177ee5fbfe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:08:18.926725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9f579-c76c-428b-a312-d177ee5fbfe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:08:18.935989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9f579-c76c-428b-a312-d177ee5fbfe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:08:18.937407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9f579-c76c-428b-a312-d177ee5fbfe0 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:08:18.946796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 761/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:08:28.586740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=32 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:08:28.942798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=70 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:44.604039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:44.605180 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:44.605674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:44.625827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:44.627405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:44.636352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 779/1540] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:44.646700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:44.651616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:44.652308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:44.673881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:44.675523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:44.684397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 762/1541] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:44.689370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:44.701165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49c90-53fc-480b-8815-01606fede3f3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:44.706345 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:44.707310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:44.707819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:44.708392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:44.709366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:44.709894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:44.711739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:44.725748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 780/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:44.734501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:44.744649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b62068-0a13-41dd-aff7-47b3caf94ce2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:44.750637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:44.751556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:44.752105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:44.752622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:44.753629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:44.756030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:44.796062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 763/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:44 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:44.800818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:44.813704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0399-2f31-4b2a-8da9-055064adf198 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:44.898355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:44.899427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:44.900081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:44.900902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:44.903053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:44.905311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:44.933374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 781/1544] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:44 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:44.938147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:44.953019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897c77-b68e-479a-a86b-3404120c5d8e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:44.960455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:44.961416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:44.961939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:44.962523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:44.964091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:44.965943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:44.981993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 764/1545] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:44.987684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:44.999479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67eec4-77a3-4529-9ca0-79bd01b6aa3f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.009476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18395e8b-8b95-47ac-ba8f-8d96f7886221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.010582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395e8b-8b95-47ac-ba8f-8d96f7886221 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.011313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395e8b-8b95-47ac-ba8f-8d96f7886221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.011811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18395e8b-8b95-47ac-ba8f-8d96f7886221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.012842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18395e8b-8b95-47ac-ba8f-8d96f7886221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.015899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18395e8b-8b95-47ac-ba8f-8d96f7886221 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.035600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 782/1546] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:45.037905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.051432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97301d4-fe77-4bf8-8263-fc23f01bf950 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.058118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.059556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.060140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.060652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] PATH_INFO: `/v3/projects/fa7e9770919e4f45895e26e993dda954/users/ce35a4e9020f45e8a8ebbd857e7eb57a/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.080875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7e9770919e4f45895e26e993dda954, user_id=ce35a4e9020f45e8a8ebbd857e7eb57a, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.084403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.108412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 765/1547] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:45 2022] PUT /identity/v3/projects/fa7e9770919e4f45895e26e993dda954/users/ce35a4e9020f45e8a8ebbd857e7eb57a/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:45.121273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c719d-0088-4cf8-b13e-4c5c881630d8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.121948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c719d-0088-4cf8-b13e-4c5c881630d8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.122456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c719d-0088-4cf8-b13e-4c5c881630d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.161709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-254c719d-0088-4cf8-b13e-4c5c881630d8 None None] MFA Rules not processed for user `ce35a4e9020f45e8a8ebbd857e7eb57a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.162851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-254c719d-0088-4cf8-b13e-4c5c881630d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.266474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 783/1548] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:09:45.271862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.350746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f6378-7c86-4a1d-acf1-aa5010d89626 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.351034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f6378-7c86-4a1d-acf1-aa5010d89626 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.351353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f6378-7c86-4a1d-acf1-aa5010d89626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.354733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4520a-853a-423d-9b3d-6933e4f7df46 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.360840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafad731-de87-4f27-9add-a6657ced2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.362759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafad731-de87-4f27-9add-a6657ced2806 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.363548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafad731-de87-4f27-9add-a6657ced2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.364087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafad731-de87-4f27-9add-a6657ced2806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.365140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafad731-de87-4f27-9add-a6657ced2806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.373148 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafad731-de87-4f27-9add-a6657ced2806 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.397425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-610f6378-7c86-4a1d-acf1-aa5010d89626 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.399811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-610f6378-7c86-4a1d-acf1-aa5010d89626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.415225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 784/1549] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:09:45.415225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b357a9-d842-4fcf-abef-ce88518fcf77 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.415225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b357a9-d842-4fcf-abef-ce88518fcf77 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.415225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b357a9-d842-4fcf-abef-ce88518fcf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.418496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 766/1550] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:45.420266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b473-e0ed-4767-b6b5-b0784ee7cd68 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.420717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b473-e0ed-4767-b6b5-b0784ee7cd68 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.421147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b473-e0ed-4767-b6b5-b0784ee7cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.440841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-99b357a9-d842-4fcf-abef-ce88518fcf77 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.441827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3ec7b473-e0ed-4767-b6b5-b0784ee7cd68 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.442417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-99b357a9-d842-4fcf-abef-ce88518fcf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.442978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3ec7b473-e0ed-4767-b6b5-b0784ee7cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.485008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:45.511161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 767/1551] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.512558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.512846 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.513118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.514932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 785/1552] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.517172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc66f69-b293-4a83-8744-87732f525334 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.517626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc66f69-b293-4a83-8744-87732f525334 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.518044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc66f69-b293-4a83-8744-87732f525334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.531587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.532980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.538744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dfc66f69-b293-4a83-8744-87732f525334 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.540062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dfc66f69-b293-4a83-8744-87732f525334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.540996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 768/1553] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.541763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.550729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 786/1554] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.552067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ea96-f02a-4901-855a-29ab7713a160 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.552361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ea96-f02a-4901-855a-29ab7713a160 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.552631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ea96-f02a-4901-855a-29ab7713a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.553650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adef9a-9917-4e3d-9e1f-b761b1524f81 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.561534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.562267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.562547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.562818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.563538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.564616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:09:45.564616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:09:45.564616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:09:45.566305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304a2b-8f9e-4aef-b3b5-7045528266f6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.576911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-63f3ea96-f02a-4901-855a-29ab7713a160 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.577764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63f3ea96-f02a-4901-855a-29ab7713a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.581650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:45.587642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 787/1555] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.588954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1e71-a5f9-46e4-840d-dda0ffad0928 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.589278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1e71-a5f9-46e4-840d-dda0ffad0928 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.589403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 769/1556] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:45.589622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1e71-a5f9-46e4-840d-dda0ffad0928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.590592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2d22-9da3-45f2-a962-b0b4ee16e0e3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.591415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2d22-9da3-45f2-a962-b0b4ee16e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.591707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2d22-9da3-45f2-a962-b0b4ee16e0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.608117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8afa1e71-a5f9-46e4-840d-dda0ffad0928 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.609326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8afa1e71-a5f9-46e4-840d-dda0ffad0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.610056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7f7f2d22-9da3-45f2-a962-b0b4ee16e0e3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.611232 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7f7f2d22-9da3-45f2-a962-b0b4ee16e0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.617280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 788/1557] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.618488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81685d4-7310-455e-ab6e-021c7cd03012 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.618773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81685d4-7310-455e-ab6e-021c7cd03012 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.619053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81685d4-7310-455e-ab6e-021c7cd03012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.625671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 770/1558] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.626978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a10fb9-33ba-4fcb-bb42-9b67b6b50674 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.627294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a10fb9-33ba-4fcb-bb42-9b67b6b50674 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.627575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a10fb9-33ba-4fcb-bb42-9b67b6b50674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.637978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d81685d4-7310-455e-ab6e-021c7cd03012 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.639190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d81685d4-7310-455e-ab6e-021c7cd03012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.646122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a5a10fb9-33ba-4fcb-bb42-9b67b6b50674 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.647100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 789/1559] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.647275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a5a10fb9-33ba-4fcb-bb42-9b67b6b50674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.648361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.648647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.648998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.655383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 771/1560] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.656759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.657140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.657508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.671765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.672925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.675146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.676389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.680925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 790/1561] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.681702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.684244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 772/1562] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.685096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.694603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6f2a6-c964-442b-9c5b-54bbfd813676 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.694798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe1965-22f0-4b87-96a5-0313b98d79d2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.699282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.699449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53c654-37ca-4105-ac79-0871cdf0a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.699970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.700133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c654-37ca-4105-ac79-0871cdf0a04b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.700255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.700394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c654-37ca-4105-ac79-0871cdf0a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.700532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.700686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53c654-37ca-4105-ac79-0871cdf0a04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.701262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.701448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c654-37ca-4105-ac79-0871cdf0a04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.701560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.703112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53c654-37ca-4105-ac79-0871cdf0a04b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.703236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3193-87e4-4d4f-bfbb-f56857aca0df admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.713184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 773/1563] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:45.714370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.714658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.714934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.722758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 791/1564] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.722758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.722758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.722758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.739154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.739777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:45.740391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.740966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:45.748514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 774/1565] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.752772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 792/1566] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:45.752921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.753010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.761577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df915-2de9-4a38-995a-7be8525e5809 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.762308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f30284-2841-48e7-a23a-2b396f358725 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.766481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.766853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.767135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.767416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.767511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.767691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.767794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.768064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.768454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.768762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.768861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.769092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.769912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:09:45.769912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:09:45.769912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:09:45.770785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.770913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.782532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 775/1567] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.782532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.789951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 793/1568] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.789951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.795552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426549b-c08a-4bd2-bcea-d51b6473fb90 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.798776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e587f-d3dc-42d5-87a8-8edfb89a0741 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.799872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.800665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.800944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.801218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.801945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.802250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.803387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.803877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.804079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.804362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.804640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.805367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.805674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.807274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.817119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 776/1569] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.817873 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.826645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 794/1570] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.826645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.830990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63021-ecfd-4219-b31e-25c825d6a6ce admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.832699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7834b-a18b-4098-b64c-8d47cf11531a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.835640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.836551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.836825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.837125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] PATH_INFO: `/v3/projects/714800a9b42a4172bff8c97680fa5906/users/390be72d6f6d44728f72e45a7f2a9a82/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.837933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.838584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.838868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.839144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.839835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.841802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.851956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714800a9b42a4172bff8c97680fa5906, user_id=390be72d6f6d44728f72e45a7f2a9a82, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.853355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:09:45.853355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:09:45.853355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:09:45.855291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.867471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 777/1571] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:45.868513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 795/1572] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:45 2022] PUT /identity/v3/projects/714800a9b42a4172bff8c97680fa5906/users/390be72d6f6d44728f72e45a7f2a9a82/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:45.868629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.872074 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.930942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c57d3-a065-4aae-b1e4-6449fbb619a0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.933743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c0c3-e338-47ea-832e-6c57d0c4f866 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.935494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.936194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.936474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.936750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.937473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.937796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.938332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.938998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.939301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.939506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.940284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.940417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:45.940590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.942260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.953770 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 778/1573] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.956087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.958661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 796/1574] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:45.959516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:45.967527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9085c-cdda-47e9-a375-e14fa60b0e54 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.969489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f4a6-9cf7-4209-ad1f-ccdda73d2369 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:45.973059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.973798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.974145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.974620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:45.974752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.974844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:45.975078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:45.975355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:45.975519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.976077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:45.977082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:09:45.977082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:09:45.977082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:09:45.978412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:45.978658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.007362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 779/1575] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.008032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.009512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 797/1576] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:45 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.010500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.024014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:46.057012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:46.074253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb219-2144-49bc-b230-f0ee87f99634 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.074445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137edd49-0f46-49c6-a701-05d4b44283e9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.078796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.078981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.079451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.079591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.079697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.079835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.079974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.080179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.080693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.080845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.082639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.082802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.109460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 780/1577] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.110286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.113874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 798/1578] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.113874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.173299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ca8bc-b7df-4847-884d-f295a1d90017 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.173606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a46ad-ba87-4f07-9e36-d7f9ff633e14 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.177977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.178109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.178672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.178774 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.178955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.179057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.179232 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.179406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.180034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.180171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.181883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.182023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.191918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 799/1579] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.191918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.202931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dfeee-a230-452b-a865-022442309c94 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.208030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 781/1580] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.208030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.210918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.211606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.211921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.212434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.213193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.215459 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.218161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7722a5-ee66-4436-a8e1-791072a08742 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.227336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.228413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.228695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.228969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.229686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.231597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.242914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 800/1581] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.246904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.263500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 782/1582] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.263500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.314730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea398c6b-7d02-4bad-a983-c0e362c4c4e0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.319701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.320406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.320685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.320942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d509c9-a1f1-40c2-a0e3-2592af99d04d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.321056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.321756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.323710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.325595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.326269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.326547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.326821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.327514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.329481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.341714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:46.347451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 801/1583] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.348644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.351380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 783/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.352521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.361383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df265c37-44c2-454f-a207-87643b046436 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.362708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009817b-3cfd-4d4f-9360-2b1c307e31e8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.366962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.367906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.368049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.368580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.368740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.368833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.368910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.369187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.369615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.369849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.371648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.371796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.398083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 784/1585] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.399031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.403679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 802/1586] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.404575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.408904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94aabc-d3a0-43f3-848a-8db35edf937c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.413371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.414035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d7c07-bd04-4ec1-bafd-b79448d1d494 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.414251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.414529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.414801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] PATH_INFO: `/v3/projects/714800a9b42a4172bff8c97680fa5906/users/390be72d6f6d44728f72e45a7f2a9a82/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.416747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=714800a9b42a4172bff8c97680fa5906, user_id=390be72d6f6d44728f72e45a7f2a9a82, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.418569 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.419251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.419405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.419516 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.419794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.420594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.422213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.423407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:46.432583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 785/1587] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:46 2022] PUT /identity/v3/projects/714800a9b42a4172bff8c97680fa5906/users/390be72d6f6d44728f72e45a7f2a9a82/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:46.433449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.439335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 803/1588] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.439335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.448219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ac9ed-5b78-479c-ba54-720d6290aab8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.497798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200fdef-ac1a-4512-bfb9-7147bc101c0d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.502668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.503372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.503671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.503968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.504225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.504670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.504926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.505229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.505547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.506259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.506603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.508250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.529666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 786/1589] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.529666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.529973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 804/1590] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:46.529973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.538880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef351082-025d-44f5-bf15-184ffcbd2f25 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.539933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1ad8-9d45-409d-893b-31ffc5af2ec1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.543921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.544433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.544627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.544854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.545091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.545215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.545397 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.545673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.545839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.546400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.547421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.548006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.558581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 787/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.558731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 805/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.559406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.559519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.569438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b0454-14f4-46b9-88f4-47a3fa73c75a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.570543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5460-25ee-4d7b-8cac-9b13cff0c1a2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.574332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.575002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.575279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f046e-6dce-420c-8607-1e5905e8963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.575403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.575555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.575962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f046e-6dce-420c-8607-1e5905e8963a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.576240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f046e-6dce-420c-8607-1e5905e8963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.576369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.576517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f046e-6dce-420c-8607-1e5905e8963a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.577219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f046e-6dce-420c-8607-1e5905e8963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.577943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.578813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f046e-6dce-420c-8607-1e5905e8963a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.588804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 806/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.589370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 788/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.590373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.590840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.591153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.591430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.601746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db2c8-f4a7-42b9-9618-8e1fc04379d6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.606954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.607614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.607931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.608310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.609033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.610658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.618233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] MFA Rules not processed for user `390be72d6f6d44728f72e45a7f2a9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:46.619445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:46.620987 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 807/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.621860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.633214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447c073-cba7-4ab1-a827-9c62c4458ad5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.637762 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.638400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.638680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.638981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.639690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.641295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.651635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 808/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.652445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.661732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c3b3-e22b-46b6-89e7-bd29e2c13adb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.666635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.667277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.667557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.667827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.668571 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.670171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.681262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 809/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.682178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.692323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de236e0-67d6-4b41-b938-efdc10fc7145 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.696706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 789/1598] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:46.697182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.697592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.697870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.698388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.699354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.700724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.700907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.711454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 810/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.712285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.714630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ceb0-4b1e-4d0b-90ac-563161950850 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.719355 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.720058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.720337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.720609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.721343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.721725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a029313-dc09-45a7-a000-f122b1a5fa90 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.723013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.726664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.727368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.727660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.728295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.729026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.730667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.733643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 790/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.734444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.740801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 811/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.741588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.744200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2345e-ded8-4bcb-aef5-a85ab3df8298 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.749161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.749818 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.750098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.750486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.750800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4b750-582e-42fa-915b-42d3c240d8bd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.751214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.752835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.755467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.756362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.756636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.756912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] PATH_INFO: `/v3/projects/401cfd41fa394f729576b632c859e927/users/99cba8e7690d47e08b25d0554c81630a/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.763560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 791/1602] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.767048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.773712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401cfd41fa394f729576b632c859e927, user_id=99cba8e7690d47e08b25d0554c81630a, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.774350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e118-a150-402b-a332-86b5b4aa7de7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.776492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.778989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.779653 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.779970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.780249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.780967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.782602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.790050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 812/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:46 2022] PUT /identity/v3/projects/401cfd41fa394f729576b632c859e927/users/99cba8e7690d47e08b25d0554c81630a/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:46.790851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.797840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 792/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.798525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.815548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:46.815839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:46.855092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4f1d2-9007-46a7-9e4b-9d558d5cca84 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.859560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34963e12-0645-49f0-8113-5211cced2fb0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.864247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.864924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.865204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.865486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.866218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.867875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.878203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 813/1605] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:46.879733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.889791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836b89d-821a-4869-9d0f-a0ad65577ab7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.895440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.896343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.896620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.896893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] PATH_INFO: `/v3/projects/98d090f6c37a4a318ae17a2f76f1fba5/users/a118f82d24624ed1ba4cd0cb046e28e5/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.902949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.903599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.903910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:46.904187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:46.913036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d090f6c37a4a318ae17a2f76f1fba5, user_id=a118f82d24624ed1ba4cd0cb046e28e5, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.915719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.930261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 814/1606] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:46 2022] PUT /identity/v3/projects/98d090f6c37a4a318ae17a2f76f1fba5/users/a118f82d24624ed1ba4cd0cb046e28e5/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:46.931086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.967324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:46.968742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:46.978638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 793/1607] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:46.980844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:46.992889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea640c-83d9-42a6-ba90-6527ca4ccb49 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:46.998627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:46.999558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:46.999837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.000135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27732105-b11b-4164-949f-f56696b64674 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.000254 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] PATH_INFO: `/v3/projects/45efa59df15f4c30a674ae05bc5c4271/users/555360abbf81465795c4900b1a38b4dd/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.006968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d9cba-c221-4901-a369-5bf28a7e9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.007889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d9cba-c221-4901-a369-5bf28a7e9979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.008329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d9cba-c221-4901-a369-5bf28a7e9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.008606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d9cba-c221-4901-a369-5bf28a7e9979 admin admin] PATH_INFO: `/v3/projects/edf2d3ac8a4646048f5235e7017ff841/users/d2c0e3c91a54496089c96c8dd2a13258/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.025732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45efa59df15f4c30a674ae05bc5c4271, user_id=555360abbf81465795c4900b1a38b4dd, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.028729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.029343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d9cba-c221-4901-a369-5bf28a7e9979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf2d3ac8a4646048f5235e7017ff841, user_id=d2c0e3c91a54496089c96c8dd2a13258, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.032085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d9cba-c221-4901-a369-5bf28a7e9979 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.045775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 794/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:46 2022] PUT /identity/v3/projects/45efa59df15f4c30a674ae05bc5c4271/users/555360abbf81465795c4900b1a38b4dd/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:47.046634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.050373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 815/1609] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:46 2022] PUT /identity/v3/projects/edf2d3ac8a4646048f5235e7017ff841/users/d2c0e3c91a54496089c96c8dd2a13258/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:47.050373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.050373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.050373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.078799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] MFA Rules not processed for user `99cba8e7690d47e08b25d0554c81630a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.080080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.111298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:47.115455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc356d-7e8a-4931-8e62-335e51c9c8c8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.144822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 816/1610] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.145746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.152567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:47.178151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.179525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.179716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.180474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] PATH_INFO: `/v3/projects/08ca961398814d4da165e1580abcba68/users/3484bdd7f4764cf3aa9a3a4c97f6efee/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.198804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ca961398814d4da165e1580abcba68, user_id=3484bdd7f4764cf3aa9a3a4c97f6efee, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.201667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.215295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 795/1611] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:47 2022] PUT /identity/v3/projects/08ca961398814d4da165e1580abcba68/users/3484bdd7f4764cf3aa9a3a4c97f6efee/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:47.215615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e7337-92a3-4dba-84cb-3ff4fea23090 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.216302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.273191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14637079-4025-49d7-87f0-d88887cad107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.274116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14637079-4025-49d7-87f0-d88887cad107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.274397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14637079-4025-49d7-87f0-d88887cad107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.274675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14637079-4025-49d7-87f0-d88887cad107 admin admin] PATH_INFO: `/v3/projects/4d88556b060047ad90d5b8e7e0993c0b/users/a253ee9232f94475a74d4971b31722b7/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.276831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b21e-8519-4dd0-b7b1-49c781c8b6ca admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.281430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325423c-00d5-4b61-9fe1-4b3d1d78e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.282323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325423c-00d5-4b61-9fe1-4b3d1d78e09d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.282637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325423c-00d5-4b61-9fe1-4b3d1d78e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.282913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325423c-00d5-4b61-9fe1-4b3d1d78e09d admin admin] PATH_INFO: `/v3/projects/7bb0f01046a74421918f80bdfcbb7846/users/b23c4b355ddf42a0b0072e7ed15f7075/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.289040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14637079-4025-49d7-87f0-d88887cad107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d88556b060047ad90d5b8e7e0993c0b, user_id=a253ee9232f94475a74d4971b31722b7, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.291757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14637079-4025-49d7-87f0-d88887cad107 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.298382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325423c-00d5-4b61-9fe1-4b3d1d78e09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb0f01046a74421918f80bdfcbb7846, user_id=b23c4b355ddf42a0b0072e7ed15f7075, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.301273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325423c-00d5-4b61-9fe1-4b3d1d78e09d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.305745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 817/1612] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:47 2022] PUT /identity/v3/projects/4d88556b060047ad90d5b8e7e0993c0b/users/a253ee9232f94475a74d4971b31722b7/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:47.307178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.307497 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.307810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.316675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 796/1613] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:47 2022] PUT /identity/v3/projects/7bb0f01046a74421918f80bdfcbb7846/users/b23c4b355ddf42a0b0072e7ed15f7075/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:47.318161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9e50-a6a7-4c22-b28d-97e8932ee5bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.318422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9e50-a6a7-4c22-b28d-97e8932ee5bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.318716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc9e50-a6a7-4c22-b28d-97e8932ee5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.335191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] MFA Rules not processed for user `a118f82d24624ed1ba4cd0cb046e28e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.336009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-51cc9e50-a6a7-4c22-b28d-97e8932ee5bf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.336428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.337394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51cc9e50-a6a7-4c22-b28d-97e8932ee5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.397629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 797/1614] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.399008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69aaa-8f98-42bc-9c16-82b254dfa8bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.399304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69aaa-8f98-42bc-9c16-82b254dfa8bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.399581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69aaa-8f98-42bc-9c16-82b254dfa8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.402811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 818/1615] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.403700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.425532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-45f69aaa-8f98-42bc-9c16-82b254dfa8bf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.426765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-45f69aaa-8f98-42bc-9c16-82b254dfa8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.432418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:47.435247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 798/1616] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.436616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19492dd-1a1b-4e69-a545-c3da64570f64 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.436904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19492dd-1a1b-4e69-a545-c3da64570f64 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.437180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19492dd-1a1b-4e69-a545-c3da64570f64 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.438439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 799/1617] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jun 24 07:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:09:47.445327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eca798-51fb-4f2d-b9da-6f73a7944041 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.445756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eca798-51fb-4f2d-b9da-6f73a7944041 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.446116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eca798-51fb-4f2d-b9da-6f73a7944041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.452869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:47.464053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eab54-cbd5-4b69-a7af-0ed0e9a5a0fb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.466890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-42eca798-51fb-4f2d-b9da-6f73a7944041 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.467668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139ee56-d970-43f7-9fd3-bd238b86efaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.468126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-42eca798-51fb-4f2d-b9da-6f73a7944041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.468356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ee56-d970-43f7-9fd3-bd238b86efaf service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.468640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ee56-d970-43f7-9fd3-bd238b86efaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.468913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ee56-d970-43f7-9fd3-bd238b86efaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.476421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 800/1618] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.477609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.478207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.478491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.505471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] MFA Rules not processed for user `a253ee9232f94475a74d4971b31722b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.506680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.525986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ee56-d970-43f7-9fd3-bd238b86efaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.528085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ee56-d970-43f7-9fd3-bd238b86efaf service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.538124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 819/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:47.539641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44426-8ce4-47d3-aa51-8fbfe23775ad None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.540128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44426-8ce4-47d3-aa51-8fbfe23775ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.540546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44426-8ce4-47d3-aa51-8fbfe23775ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.569048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e9a44426-8ce4-47d3-aa51-8fbfe23775ad None None] MFA Rules not processed for user `b23c4b355ddf42a0b0072e7ed15f7075`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.570316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e9a44426-8ce4-47d3-aa51-8fbfe23775ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.575322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 801/1620] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.576077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.587146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b2a49-b150-4d5d-9ba0-0af3ae72cbc9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.592811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.593463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.593740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.594015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.594937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.597683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.625691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 802/1621] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:47.626870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.630341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.641373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 820/1622] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.642763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.643056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.643335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.663624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:47.664923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:47.708364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca091c-7aec-4b1e-a714-e6717506dd5a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.713536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.713939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.714242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.714472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.733181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:47.745476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 821/1623] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:47.746223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.755182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03985283-b6ec-4dc7-af1d-804131dd0eb7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.758883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.759558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.759837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.760145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.781236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.782622 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.798386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 803/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:47.799519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.809546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4f804-3b1f-4742-853f-07d945440c8f service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.814481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.815315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.815758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.816234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.831145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.832431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.848774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 804/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:47.850045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.855203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:47.861035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730d2f3-e599-4929-98a5-ce4ca1407750 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.865255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.866946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.868793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.869821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.870539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.870920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.872097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.874465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.878605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 822/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:47.879567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.893552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc186db5-d723-4d87-a818-ccc1006a8d71 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.902683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.903759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.903969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.904412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:47.905216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:47.908389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 805/1627] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:47.908389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.908670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:47.934753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 823/1628] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:47 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:47.937626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:47.952603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3095-2fb7-48c7-94cd-eede1c66bbf1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.976918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b83b-35aa-4288-9672-86a84ae2e2e2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:47.982583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:47.983353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:47.983736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:47.984007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.033612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.034222 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.034532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.034869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.052112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.053664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.065784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 806/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:48.066981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.103890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.105597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.117842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 824/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:48.118432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.134811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:48.182063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74389dd-aed8-4995-bc37-c87a56f31fe5 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.188647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.189844 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.190353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.191067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.192254 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.194694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.228402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 807/1631] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:48 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:48.230211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.234146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf132a-bd03-4d39-af81-f90f53e9014f service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.243050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47807d7f-859e-4ef5-a6ee-cc47f90323a6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.246343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.247112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.247412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.247696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.248448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.249280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.250020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.250132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.250407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.250749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.252391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.254434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.269036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 808/1632] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:48.275891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 825/1633] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:48.276061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.276871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.287597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe22e-a472-4b64-9936-6d591e18c266 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.292345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.294024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.294505 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.294853 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] PATH_INFO: `/v3/projects/e625840c19864e8b93f2c96fe66cefb4/users/fcf35c1a3c2f44b8b26ff38941cf0996/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.295538 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd89521-ff0e-4eca-ad1b-d5f1d1f0c7e5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.301843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.302399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.302787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.303124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] PATH_INFO: `/v3/projects/78cd540675854b06a4cadc26d810a671/users/a3473a6de8294396b9c91fd6b12f9186/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.325935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:48.335814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e625840c19864e8b93f2c96fe66cefb4, user_id=fcf35c1a3c2f44b8b26ff38941cf0996, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.337593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cd540675854b06a4cadc26d810a671, user_id=a3473a6de8294396b9c91fd6b12f9186, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.344933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.346109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.387022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 809/1634] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:48 2022] PUT /identity/v3/projects/e625840c19864e8b93f2c96fe66cefb4/users/fcf35c1a3c2f44b8b26ff38941cf0996/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:48.388052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.390299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 826/1635] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:48 2022] PUT /identity/v3/projects/78cd540675854b06a4cadc26d810a671/users/a3473a6de8294396b9c91fd6b12f9186/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:09:48.393928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.496727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b31ae-8a9c-43c0-a811-091142c8f532 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.497850 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e550-a0db-47e2-a8f8-ce9839f9aa4a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.503108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5992b9-cbb2-454d-9c18-9e7afd290b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.503524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.504007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5992b9-cbb2-454d-9c18-9e7afd290b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.504286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5992b9-cbb2-454d-9c18-9e7afd290b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.504414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.504592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.504748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5992b9-cbb2-454d-9c18-9e7afd290b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.504888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.505464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5992b9-cbb2-454d-9c18-9e7afd290b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.505644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.507234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5992b9-cbb2-454d-9c18-9e7afd290b77 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.507690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.522344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 827/1636] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:48.524035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461eef7-883f-4d4e-8822-b0ca69c927d5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.524180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 810/1637] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:48.524367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461eef7-883f-4d4e-8822-b0ca69c927d5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.524652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461eef7-883f-4d4e-8822-b0ca69c927d5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.525277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.526193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 828/1638] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jun 24 07:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:09:48.531627 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461eef7-883f-4d4e-8822-b0ca69c927d5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.537831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c635c-dcea-48b6-b9a7-56cdbc83879c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.544717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443a72-4cfd-4c9d-82dc-89b218e5495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.546571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443a72-4cfd-4c9d-82dc-89b218e5495f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.547108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443a72-4cfd-4c9d-82dc-89b218e5495f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.547585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443a72-4cfd-4c9d-82dc-89b218e5495f admin admin] PATH_INFO: `/v3/projects/e625840c19864e8b93f2c96fe66cefb4/users/fcf35c1a3c2f44b8b26ff38941cf0996/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.548749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461eef7-883f-4d4e-8822-b0ca69c927d5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.551188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1443a72-4cfd-4c9d-82dc-89b218e5495f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e625840c19864e8b93f2c96fe66cefb4, user_id=fcf35c1a3c2f44b8b26ff38941cf0996, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.554574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1443a72-4cfd-4c9d-82dc-89b218e5495f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.560355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06167-4c84-4cfb-b60e-e6ab51819ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.561738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06167-4c84-4cfb-b60e-e6ab51819ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.562507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06167-4c84-4cfb-b60e-e6ab51819ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.563116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06167-4c84-4cfb-b60e-e6ab51819ac9 admin admin] PATH_INFO: `/v3/projects/78cd540675854b06a4cadc26d810a671/users/a3473a6de8294396b9c91fd6b12f9186/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.565916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae06167-4c84-4cfb-b60e-e6ab51819ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cd540675854b06a4cadc26d810a671, user_id=a3473a6de8294396b9c91fd6b12f9186, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.569129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae06167-4c84-4cfb-b60e-e6ab51819ac9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.578977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 811/1639] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:48 2022] PUT /identity/v3/projects/e625840c19864e8b93f2c96fe66cefb4/users/fcf35c1a3c2f44b8b26ff38941cf0996/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:48.580633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6dc43-76de-4bfd-ae64-732419e71c95 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.581457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6dc43-76de-4bfd-ae64-732419e71c95 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.581457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6dc43-76de-4bfd-ae64-732419e71c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.588810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 829/1640] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:48 2022] PUT /identity/v3/projects/78cd540675854b06a4cadc26d810a671/users/a3473a6de8294396b9c91fd6b12f9186/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:48.591674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.592239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.592696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.606310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3be6dc43-76de-4bfd-ae64-732419e71c95 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:48.607767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3be6dc43-76de-4bfd-ae64-732419e71c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:48.660264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] MFA Rules not processed for user `fcf35c1a3c2f44b8b26ff38941cf0996`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:48.661607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:48.766930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 812/1641] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:09:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:48.768570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.768859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.769453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.777189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:48.803578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 830/1642] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:48.804631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:48.832497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] MFA Rules not processed for user `a3473a6de8294396b9c91fd6b12f9186`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:48.834171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:48.917436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:48.921375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e96775-76fe-47b6-a3ac-13798834681a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:48.925640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:48.926305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:48.926582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:48.926854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:48.942777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:48.944313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:48.951472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 813/1643] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:48.982719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 831/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:48.984332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:49.000690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843d6c-bdc9-4f9a-9009-9020e876f523 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:49.005154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:49.005834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:49.006118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:49.006395 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:49.018656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:49.020556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:49.033680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 814/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:49.152957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:49.163454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082af49-14ae-4be4-b7f0-2c803a375cfb service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:49.169346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:49.170614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:49.170614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:49.176432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:49.189339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:49.191856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:49.204808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 832/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:49.436353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:49.451585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad8fb2-feb1-4d79-92e4-70c329202bc3 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:49.455701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebb599-4424-46be-9450-1182b6ff9537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:49.456644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb599-4424-46be-9450-1182b6ff9537 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:49.457045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb599-4424-46be-9450-1182b6ff9537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:49.458058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb599-4424-46be-9450-1182b6ff9537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:49.504932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:49.529840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70e760-8a35-4691-86de-fa527ff8d946 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:49.537238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74da84-e5dc-418f-8e20-ea484ee50325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:49.538096 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74da84-e5dc-418f-8e20-ea484ee50325 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:49.538490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74da84-e5dc-418f-8e20-ea484ee50325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:49.538829 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74da84-e5dc-418f-8e20-ea484ee50325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:49.622103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebb599-4424-46be-9450-1182b6ff9537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:49.623839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebb599-4424-46be-9450-1182b6ff9537 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:49.623990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74da84-e5dc-418f-8e20-ea484ee50325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:49.625472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74da84-e5dc-418f-8e20-ea484ee50325 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:49.638658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 833/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:49.647362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 815/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:50.588724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239829-4533-4e45-a351-13f781f45ebe None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:50.589289 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239829-4533-4e45-a351-13f781f45ebe None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:50.589289 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239829-4533-4e45-a351-13f781f45ebe None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:50.590747 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 834/1649] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jun 24 07:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:09:50.609328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101d601-7d0c-4c7e-9a89-3c63a5376e5b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:50.609951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101d601-7d0c-4c7e-9a89-3c63a5376e5b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:50.610119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101d601-7d0c-4c7e-9a89-3c63a5376e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:50.653283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1101d601-7d0c-4c7e-9a89-3c63a5376e5b None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:50.654624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1101d601-7d0c-4c7e-9a89-3c63a5376e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:50.683204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 816/1650] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jun 24 07:09:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:50.689399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb121-415f-4ed3-9087-5033eba088ad None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:50.689690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb121-415f-4ed3-9087-5033eba088ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:50.689972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb121-415f-4ed3-9087-5033eba088ad None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:50.691518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 835/1651] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jun 24 07:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:09:50.697807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:50.698817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:50.699140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:50.750331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:50.751677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:50.768642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 817/1652] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:09:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:51.017743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb121-415f-4ed3-9087-5033eba088ad None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:51.038855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb121-415f-4ed3-9087-5033eba088ad None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:51.059065 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa6a2-a572-47a5-bbd2-502dfd33bf1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:51.060542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa6a2-a572-47a5-bbd2-502dfd33bf1f service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:51.062170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa6a2-a572-47a5-bbd2-502dfd33bf1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:51.062543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa6a2-a572-47a5-bbd2-502dfd33bf1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:51.104974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa6a2-a572-47a5-bbd2-502dfd33bf1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:51.106673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa6a2-a572-47a5-bbd2-502dfd33bf1f service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:51.145559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 836/1653] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:52.189960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:52.283185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec30b8-989f-4c92-951e-aedf86aa86a6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:52.288894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:52.289916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:52.290111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:52.290426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] PATH_INFO: `/v3/users/ce35a4e9020f45e8a8ebbd857e7eb57a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:52.295039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce35a4e9020f45e8a8ebbd857e7eb57a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:52.306927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:52.396231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce35a4e9020f45e8a8ebbd857e7eb57a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:52.433133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:52.436493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce35a4e9020f45e8a8ebbd857e7eb57a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:52.451760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce35a4e9020f45e8a8ebbd857e7eb57a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:52.453341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce35a4e9020f45e8a8ebbd857e7eb57a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:52.454194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce35a4e9020f45e8a8ebbd857e7eb57a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:52.473523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 818/1654] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:09:52 2022] DELETE /identity/v3/users/ce35a4e9020f45e8a8ebbd857e7eb57a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:52.478438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:52.479437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:52.479902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:52.531642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:52.561528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:52.788810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 837/1655] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:52.817426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:52.819105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:52.984041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122fc0e-687f-478a-9c59-affefce9461b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:52.996961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:52.997671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:52.997958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:52.998237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:53.023692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:53.025255 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:53.056333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 819/1656] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:09:54.902573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:54.911044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:54.939893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630aaf7-2667-4733-a372-5e00cb6903dc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:54.967017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:54.968237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:54.968519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:54.968797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] PATH_INFO: `/v3/projects/fa7e9770919e4f45895e26e993dda954` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:54.975960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7e9770919e4f45895e26e993dda954)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:54.988750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:55.007865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:55.123258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7e9770919e4f45895e26e993dda954', 'request_id': 'req-7c89706d-9fcd-4baa-96d8-bca6a0afe495'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.141177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7e9770919e4f45895e26e993dda954', 'request_id': 'req-7c89706d-9fcd-4baa-96d8-bca6a0afe495'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.157915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7e9770919e4f45895e26e993dda954', 'request_id': 'req-7c89706d-9fcd-4baa-96d8-bca6a0afe495'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.190066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] The token cache is being invalidate because project fa7e9770919e4f45895e26e993dda954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:09:55.190734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.192142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c89706d-9fcd-4baa-96d8-bca6a0afe495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.200142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 838/1657] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:09:54 2022] DELETE /identity/v3/projects/fa7e9770919e4f45895e26e993dda954 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:55.200718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:55.213949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf195d-f5f6-473e-9f09-f4084772fcbf service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:55.306644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:55.308187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:55.308675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:55.310230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] PATH_INFO: `/v3/users/390be72d6f6d44728f72e45a7f2a9a82` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:55.311697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390be72d6f6d44728f72e45a7f2a9a82)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:55.314920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:55.414254 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390be72d6f6d44728f72e45a7f2a9a82'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.439982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390be72d6f6d44728f72e45a7f2a9a82'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.465224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390be72d6f6d44728f72e45a7f2a9a82'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.465847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390be72d6f6d44728f72e45a7f2a9a82'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.466111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390be72d6f6d44728f72e45a7f2a9a82'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:55.492851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 820/1658] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:09:55 2022] DELETE /identity/v3/users/390be72d6f6d44728f72e45a7f2a9a82 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:09:56.552080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:56.552645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:56.552645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:56.629439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] MFA Rules not processed for user `3484bdd7f4764cf3aa9a3a4c97f6efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:56.630636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:56.708887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:56.710316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:56.717721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:56.832205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 839/1659] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:56.842833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:56.844738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:56.954006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b49e-1af2-4d17-a1c1-8305ff17fe42 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:56.975468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:56.977054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:56.977507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:56.978274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] PATH_INFO: `/v3/projects/714800a9b42a4172bff8c97680fa5906` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:56.979729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=714800a9b42a4172bff8c97680fa5906)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:56.980932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: WARNING py.warnings [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:09:56.980932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: warnings.warn(msg) Jun 24 07:09:56.980932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: Jun 24 07:09:56.982962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:56.992154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ec7b-af3d-4b89-b1b1-6b834d35c474 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:57.007677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ae3f-aec9-4070-a733-cbcbcb68dcd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:57.009956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ae3f-aec9-4070-a733-cbcbcb68dcd8 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:57.010896 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ae3f-aec9-4070-a733-cbcbcb68dcd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:57.013557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ae3f-aec9-4070-a733-cbcbcb68dcd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:57.046911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ae3f-aec9-4070-a733-cbcbcb68dcd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:57.050859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ae3f-aec9-4070-a733-cbcbcb68dcd8 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:57.090049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 840/1660] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:09:57.130104 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714800a9b42a4172bff8c97680fa5906', 'request_id': 'req-bcc3d677-9367-4a56-b807-d69204be5cdd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:57.141843 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714800a9b42a4172bff8c97680fa5906', 'request_id': 'req-bcc3d677-9367-4a56-b807-d69204be5cdd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:57.179965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714800a9b42a4172bff8c97680fa5906', 'request_id': 'req-bcc3d677-9367-4a56-b807-d69204be5cdd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:57.227143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] The token cache is being invalidate because project 714800a9b42a4172bff8c97680fa5906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:09:57.227437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:57.230367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bcc3d677-9367-4a56-b807-d69204be5cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:09:57.244880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 821/1661] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:09:56 2022] DELETE /identity/v3/projects/714800a9b42a4172bff8c97680fa5906 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:09:57.247460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:57.247460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:57.247460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:57.264349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:57.309634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:57.309634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:57.513602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 841/1662] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:57.517571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:57.518112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:57.518606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:57.568435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:57.569905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:57.595281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 822/1663] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:57.599247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:57.610662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661fee5-4a8f-4349-a35d-538f9f70ce2f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:57.631305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:57.632054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:57.632388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:57.632614 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:57.639839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:09:57.640334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:57.645387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:57.673420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 842/1664] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:09:57.680318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:57.696593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afbae8-5f19-4fe1-87a0-35fd1afd8a11 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:57.708769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:57.709731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:57.710279 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:57.711299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:57.713010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:57.718731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:57.778948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 823/1665] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:57 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:09:57.782959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:57.798811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e93bff-fee0-4152-b9aa-b2c5f5095805 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:57.933839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:57.934536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:57.940729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:57.941119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:57.942956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:57.943946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:57.985449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 843/1666] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:57 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:57.989885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:58.004723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cded5cc-69f4-42e7-92a8-6b26f12008f9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:58.024402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:58.025476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:58.025937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:58.026387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:58.027348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:58.029400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:58.051093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 824/1667] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:09:58.055299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:58.070849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb2dc-4d54-4bd9-9921-1961a3720cd0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:58.092723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a588-fe05-441d-a0db-03c4edbb7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:58.093580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a588-fe05-441d-a0db-03c4edbb7d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:58.094099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a588-fe05-441d-a0db-03c4edbb7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:58.094449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a588-fe05-441d-a0db-03c4edbb7d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:58.095276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425a588-fe05-441d-a0db-03c4edbb7d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:58.098246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425a588-fe05-441d-a0db-03c4edbb7d40 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:58.120132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 844/1668] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:09:58.124302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:58.140060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a36fb-7d15-451b-87f0-0c41ad99e450 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:58.146674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:58.148521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:58.149155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:58.149633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] PATH_INFO: `/v3/projects/1afbacbc9eb547ac919c7abd9c5fbf6a/users/fb5fdafb87f64da7ab096201236c0406/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:58.170290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afbacbc9eb547ac919c7abd9c5fbf6a, user_id=fb5fdafb87f64da7ab096201236c0406, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:58.174565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:58.192714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 825/1669] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:58 2022] PUT /identity/v3/projects/1afbacbc9eb547ac919c7abd9c5fbf6a/users/fb5fdafb87f64da7ab096201236c0406/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:09:58.205119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:58.205613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:58.206086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:58.258052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] MFA Rules not processed for user `fb5fdafb87f64da7ab096201236c0406`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:58.261260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:58.456897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 845/1670] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:58.460749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:58.537126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:58.638799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7da6-bffb-4d05-b0a2-7d80b5fb2d84 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:58.664918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:58.665297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:58.665779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:58.666142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:58.667154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:58.670054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:58.725516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 826/1671] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:09:58 2022] POST /identity/v3/projects => generated 369 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:09:58.730386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:58.738530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:09:58.752019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2f344-c420-4bf0-b9a4-9f4b18b6413d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:58.914653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:58.917117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:58.919253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:58.919721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:58.920490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:58.927287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:58.977285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 846/1672] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:09:58 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:09:58.980651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:58.994515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7ecd5-658f-4aaf-960e-58d33414bf9d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:59.011174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:59.012127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:59.012605 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:59.013122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:59.014198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:59.016048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:59.032211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 827/1673] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:59.033204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:59.046205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b4c4c-0af7-4b2b-81fa-add980c6de81 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:59.059659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:59.062955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:59.063250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:59.063536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] PATH_INFO: `/v3/projects/9d5ae48f96964307be6229579f866fcd/users/9f341f987b6d449b80a28c3262337693/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:59.108410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5ae48f96964307be6229579f866fcd, user_id=9f341f987b6d449b80a28c3262337693, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:59.116022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:59.141333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 847/1674] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:59 2022] PUT /identity/v3/projects/9d5ae48f96964307be6229579f866fcd/users/9f341f987b6d449b80a28c3262337693/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:09:59.145489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:59.161188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f474e5-b0ea-43a5-aa4e-d8eb27944b5f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:59.310264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2810e-747d-49f7-9af0-05e72e9a5003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:59.310980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2810e-747d-49f7-9af0-05e72e9a5003 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:59.311259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2810e-747d-49f7-9af0-05e72e9a5003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:59.311536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2810e-747d-49f7-9af0-05e72e9a5003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:59.312714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2810e-747d-49f7-9af0-05e72e9a5003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:59.316388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2810e-747d-49f7-9af0-05e72e9a5003 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:59.341786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:59.342810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 828/1675] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:09:59.378006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c04e7-a51f-4be8-9972-5c09e016122d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:59.406176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:59.407139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:59.407423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:59.408347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] PATH_INFO: `/v3/projects/9d5ae48f96964307be6229579f866fcd/users/9f341f987b6d449b80a28c3262337693/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:59.411954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5ae48f96964307be6229579f866fcd, user_id=9f341f987b6d449b80a28c3262337693, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:59.417340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:59.436062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 848/1676] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:09:59 2022] PUT /identity/v3/projects/9d5ae48f96964307be6229579f866fcd/users/9f341f987b6d449b80a28c3262337693/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:09:59.449051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9817-b9fe-4088-8e1a-a979e7297811 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:59.449354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9817-b9fe-4088-8e1a-a979e7297811 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:59.449750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9817-b9fe-4088-8e1a-a979e7297811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:59.517340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-17ee9817-b9fe-4088-8e1a-a979e7297811 None None] MFA Rules not processed for user `9f341f987b6d449b80a28c3262337693`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:09:59.518512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-17ee9817-b9fe-4088-8e1a-a979e7297811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:59.628034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 829/1677] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:09:59.639556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:09:59.641358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:09:59.761171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0583a-0e3a-40b9-919d-7fd7d23bd4a9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:09:59.770411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104204-2b30-4d59-81c2-87dc3543c5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:09:59.771640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104204-2b30-4d59-81c2-87dc3543c5ac service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:09:59.771954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104204-2b30-4d59-81c2-87dc3543c5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:09:59.772250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104204-2b30-4d59-81c2-87dc3543c5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:09:59.797957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104204-2b30-4d59-81c2-87dc3543c5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:09:59.799496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104204-2b30-4d59-81c2-87dc3543c5ac service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:09:59.827114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 849/1678] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:09:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:10:00.128758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768612-8450-425b-900e-9448dcc70203 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:00.129280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768612-8450-425b-900e-9448dcc70203 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:00.129350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768612-8450-425b-900e-9448dcc70203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:00.171090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-01768612-8450-425b-900e-9448dcc70203 None None] MFA Rules not processed for user `3484bdd7f4764cf3aa9a3a4c97f6efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:00.173156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01768612-8450-425b-900e-9448dcc70203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:00.220837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:00.296964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 830/1679] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:00.995684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:00.998680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:00.999150 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.067616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] MFA Rules not processed for user `555360abbf81465795c4900b1a38b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:01.069206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.146621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:01.204667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9805fb-525c-4867-8300-48cefd02e182 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.205183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9805fb-525c-4867-8300-48cefd02e182 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.205183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9805fb-525c-4867-8300-48cefd02e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.205879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 850/1680] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:01.248034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dd9805fb-525c-4867-8300-48cefd02e182 None None] MFA Rules not processed for user `555360abbf81465795c4900b1a38b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:01.250304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dd9805fb-525c-4867-8300-48cefd02e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.263298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 831/1681] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:01.273276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:01.280002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.363333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c21a3-177c-4440-a210-94432fc0ddfa None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.363690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c21a3-177c-4440-a210-94432fc0ddfa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.364176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c21a3-177c-4440-a210-94432fc0ddfa None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.365715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 832/1682] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jun 24 07:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 07:10:01.377583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.377988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.378319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.489423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] MFA Rules not processed for user `d6e8bab40c4b4f029d9ac7600d756797`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:01.492004 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.497308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa461b9d-38cf-4bf0-83ea-5b61f4caf76e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:01.517734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a7fa8-bce2-456f-a340-9b2e1e56b8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:01.518558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7fa8-bce2-456f-a340-9b2e1e56b8d0 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.518945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7fa8-bce2-456f-a340-9b2e1e56b8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.519217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7fa8-bce2-456f-a340-9b2e1e56b8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.552733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7fa8-bce2-456f-a340-9b2e1e56b8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:01.561606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7fa8-bce2-456f-a340-9b2e1e56b8d0 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:01.582532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 851/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:01.607646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ad498-24d8-4102-ac70-dd2c5d197368 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.608153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ad498-24d8-4102-ac70-dd2c5d197368 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.608710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ad498-24d8-4102-ac70-dd2c5d197368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.689448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-450ad498-24d8-4102-ac70-dd2c5d197368 None None] MFA Rules not processed for user `d2c0e3c91a54496089c96c8dd2a13258`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:01.690765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-450ad498-24d8-4102-ac70-dd2c5d197368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.697677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 833/1684] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:01.714519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:01.721300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.741478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0e111-bdd4-45a3-a0d5-2199a162ec27 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:01.748629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4dd2e-e2ab-4e81-99c2-23812ecfa09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:01.752766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4dd2e-e2ab-4e81-99c2-23812ecfa09f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.753836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4dd2e-e2ab-4e81-99c2-23812ecfa09f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.754152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4dd2e-e2ab-4e81-99c2-23812ecfa09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.783420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4dd2e-e2ab-4e81-99c2-23812ecfa09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:01.785001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4dd2e-e2ab-4e81-99c2-23812ecfa09f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:01.823147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 834/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:01.875714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 852/1686] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:01.881037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc44167-5603-40d8-995b-5edf45a2d28e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:01.881400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc44167-5603-40d8-995b-5edf45a2d28e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:01.881803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc44167-5603-40d8-995b-5edf45a2d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:01.936840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ccc44167-5603-40d8-995b-5edf45a2d28e None None] MFA Rules not processed for user `d2c0e3c91a54496089c96c8dd2a13258`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:01.938919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ccc44167-5603-40d8-995b-5edf45a2d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:01.949646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 835/1687] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:02.624044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ac992-1c31-425d-9c5b-9bb544809e81 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:02.624657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ac992-1c31-425d-9c5b-9bb544809e81 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:02.624657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ac992-1c31-425d-9c5b-9bb544809e81 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:02.626951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 853/1688] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jun 24 07:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:10:02.641823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:02.643819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:02.644163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:02.690801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] MFA Rules not processed for user `d6e8bab40c4b4f029d9ac7600d756797`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:02.697882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:02.730941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 836/1689] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:10:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:02.744238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ac992-1c31-425d-9c5b-9bb544809e81 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:02.780699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:02.787276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:02.810246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ac992-1c31-425d-9c5b-9bb544809e81 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:02.832582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bea0a-edb0-4956-9a4a-58236bf2d5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:02.833328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bea0a-edb0-4956-9a4a-58236bf2d5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:02.836367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f69-2ea8-4ec5-be25-93ca3fec6e19 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:02.836926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bea0a-edb0-4956-9a4a-58236bf2d5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:02.837461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bea0a-edb0-4956-9a4a-58236bf2d5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:02.846451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d86a7-0153-4eca-8a12-141d3644875b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:02.847179 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d86a7-0153-4eca-8a12-141d3644875b service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:02.847834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d86a7-0153-4eca-8a12-141d3644875b service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:02.848328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d86a7-0153-4eca-8a12-141d3644875b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:02.868751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d86a7-0153-4eca-8a12-141d3644875b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:02.871771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d86a7-0153-4eca-8a12-141d3644875b service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:02.871899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bea0a-edb0-4956-9a4a-58236bf2d5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:02.884120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bea0a-edb0-4956-9a4a-58236bf2d5d9 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:02.914507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 837/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:02.948253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 854/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:03.038798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b042-1ce6-43e7-9ff4-c47be853504f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:03.039098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b042-1ce6-43e7-9ff4-c47be853504f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:03.039369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b042-1ce6-43e7-9ff4-c47be853504f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:03.041055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 838/1692] 10.222.0.27 () {54 vars in 960 bytes} [Fri Jun 24 07:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:10:03.062898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:03.063364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:03.064286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:03.074112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b042-1ce6-43e7-9ff4-c47be853504f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:03.093951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:03.095562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:03.196866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:03.242405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b042-1ce6-43e7-9ff4-c47be853504f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:03.253175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 855/1693] 10.222.0.27 () {58 vars in 1057 bytes} [Fri Jun 24 07:10:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:03.274722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:03.274891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:03.275821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:03.276136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:03.276413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] PATH_INFO: `/v3/users/fb5fdafb87f64da7ab096201236c0406` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:03.279137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5fdafb87f64da7ab096201236c0406)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:03.279606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:03.298893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c23421-0b96-44cf-b70a-9258e31d0a7b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:03.317260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6637a4d8b7104d158d4d9952cc2a5216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:03.318698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:03.318698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:03.318698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:03.321854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:03.334893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:03.335589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:03.337971 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5de23-b787-4faf-b320-f7ca6373cb53 service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:03.360671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 856/1694] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:03.404309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5fdafb87f64da7ab096201236c0406'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:03.429575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5fdafb87f64da7ab096201236c0406'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:03.446300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5fdafb87f64da7ab096201236c0406'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:03.447166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5fdafb87f64da7ab096201236c0406'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:03.448090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5fdafb87f64da7ab096201236c0406'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:03.474037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 839/1695] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:03 2022] DELETE /identity/v3/users/fb5fdafb87f64da7ab096201236c0406 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:03.479465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209e39d-bd8e-4b7c-9068-4338f327aa1e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:03.479879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209e39d-bd8e-4b7c-9068-4338f327aa1e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:03.480253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209e39d-bd8e-4b7c-9068-4338f327aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:03.514070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c209e39d-bd8e-4b7c-9068-4338f327aa1e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:03.517366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c209e39d-bd8e-4b7c-9068-4338f327aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:03.782644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 857/1696] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:03.792759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:03.794265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:03.973706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111724-4f63-4e42-92b1-8d8d24f8e2c3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:03.989266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:03.990215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:03.990645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:03.991492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:04.029179 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:04.035124 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:04.079467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 840/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:05.600333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:05.600979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:05.601223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:05.624070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:05.625651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:05.647034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d3164-19df-4e28-980b-4c1f534a4548 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:05.665141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:05.668726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:05.669456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:05.671533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] MFA Rules not processed for user `555360abbf81465795c4900b1a38b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:05.673141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] PATH_INFO: `/v3/users/99cba8e7690d47e08b25d0554c81630a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:05.683579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cba8e7690d47e08b25d0554c81630a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:05.685068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:05.690354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:05.798440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 858/1698] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:05.799608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:05.804720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:05.827357 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cba8e7690d47e08b25d0554c81630a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:05.836486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7eab6-c6fe-4d8a-8c20-0141e06ed25c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:05.847068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:05.849665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:05.851101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:05.851734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] PATH_INFO: `/v3/projects/1afbacbc9eb547ac919c7abd9c5fbf6a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:05.854339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afbacbc9eb547ac919c7abd9c5fbf6a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:05.859275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:05.896076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cba8e7690d47e08b25d0554c81630a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:05.916350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cba8e7690d47e08b25d0554c81630a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:05.917256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cba8e7690d47e08b25d0554c81630a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:05.920405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cba8e7690d47e08b25d0554c81630a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:05.962782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 841/1699] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:05 2022] DELETE /identity/v3/users/99cba8e7690d47e08b25d0554c81630a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:05.965600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:05.972188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:05.994756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afbacbc9eb547ac919c7abd9c5fbf6a', 'request_id': 'req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.006611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afbacbc9eb547ac919c7abd9c5fbf6a', 'request_id': 'req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.020371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afbacbc9eb547ac919c7abd9c5fbf6a', 'request_id': 'req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.036364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:06.042364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] The token cache is being invalidate because project 1afbacbc9eb547ac919c7abd9c5fbf6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:06.043072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.044153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fd5b27f-8268-4980-ada4-f7f14a0e7d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.048332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 859/1700] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:05 2022] DELETE /identity/v3/projects/1afbacbc9eb547ac919c7abd9c5fbf6a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:06.050364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:06.050456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:06.050680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:06.092344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:06.098140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:06.099437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:06.328823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 860/1701] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:06.330078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:06.333746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:06.362186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538fe1-bc62-423d-8fb6-24140629b0e8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:06.378678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f12c8-2ced-48e2-b58c-36512375614e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:06.400630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:06.401796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:06.402080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:06.402546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] PATH_INFO: `/v3/users/b23c4b355ddf42a0b0072e7ed15f7075` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:06.403956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23c4b355ddf42a0b0072e7ed15f7075)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:06.406510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:06.420850 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:06.428459 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:06.428892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:06.429290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] PATH_INFO: `/v3/users/9f341f987b6d449b80a28c3262337693` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:06.438002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f341f987b6d449b80a28c3262337693)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:06.439277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: WARNING py.warnings [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 07:10:06.439277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: warnings.warn(msg) Jun 24 07:10:06.439277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: Jun 24 07:10:06.447030 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:06.507273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23c4b355ddf42a0b0072e7ed15f7075'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.566470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23c4b355ddf42a0b0072e7ed15f7075'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.604047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23c4b355ddf42a0b0072e7ed15f7075'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.604938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23c4b355ddf42a0b0072e7ed15f7075'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.605831 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23c4b355ddf42a0b0072e7ed15f7075'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.637042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 842/1702] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:05 2022] DELETE /identity/v3/users/b23c4b355ddf42a0b0072e7ed15f7075 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:06.638263 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:06.645387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:06.690577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f341f987b6d449b80a28c3262337693'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.761039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f341f987b6d449b80a28c3262337693'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.788365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f341f987b6d449b80a28c3262337693'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.789332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f341f987b6d449b80a28c3262337693'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.809548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-eb358377-4d3b-490e-bce3-309a13d0e4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f341f987b6d449b80a28c3262337693'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:06.823596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574b3b-797e-4edc-9582-8d09deb80d47 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:06.830372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:06.831723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 861/1703] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:06 2022] DELETE /identity/v3/users/9f341f987b6d449b80a28c3262337693 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:06.844860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:06.848288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:06.848846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:06.849209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:06.850222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:06.851647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:06.860005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:06.896432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:06.901244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:07.000649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:07.052937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:07.055726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:07.082800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 843/1704] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:07.088547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 862/1705] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:07.100894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:07.102430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:07.125964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332384d-0b3c-4059-a1e0-a5b5483fffd7 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:07.235039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:07.236158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:07.236539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:07.236903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:07.250892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:07.252766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:07.272468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 844/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:10:08.388178 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:08.390744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:08.424130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155e3f5-074a-486e-a0be-ac052939f30d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:08.437181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:08.438659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:08.449742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:08.451780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:08.456191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:08.458312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] PATH_INFO: `/v3/projects/401cfd41fa394f729576b632c859e927` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:08.463786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=401cfd41fa394f729576b632c859e927)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:08.470382 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:08.474903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98d0e-7179-45f5-be89-5320bb0ab758 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:08.498072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:08.501982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:08.502281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:08.505016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] PATH_INFO: `/v3/projects/9d5ae48f96964307be6229579f866fcd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:08.508451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5ae48f96964307be6229579f866fcd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:08.514619 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:08.527129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:08.634046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401cfd41fa394f729576b632c859e927', 'request_id': 'req-d744c9df-820c-4218-86ad-2e6beca6df90'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.647073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401cfd41fa394f729576b632c859e927', 'request_id': 'req-d744c9df-820c-4218-86ad-2e6beca6df90'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.654988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401cfd41fa394f729576b632c859e927', 'request_id': 'req-d744c9df-820c-4218-86ad-2e6beca6df90'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.679926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] The token cache is being invalidate because project 401cfd41fa394f729576b632c859e927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:08.681675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.683669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.688034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 863/1707] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:08 2022] DELETE /identity/v3/projects/401cfd41fa394f729576b632c859e927 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:08.690997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:08.695411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:08.736891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5ae48f96964307be6229579f866fcd', 'request_id': 'req-69e96b19-e400-4127-b4ba-8f3e5532c3a9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.789550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5ae48f96964307be6229579f866fcd', 'request_id': 'req-69e96b19-e400-4127-b4ba-8f3e5532c3a9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.825503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5ae48f96964307be6229579f866fcd', 'request_id': 'req-69e96b19-e400-4127-b4ba-8f3e5532c3a9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.855756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744c9df-820c-4218-86ad-2e6beca6df90 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:08.856736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] The token cache is being invalidate because project 9d5ae48f96964307be6229579f866fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:08.857083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.857790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-69e96b19-e400-4127-b4ba-8f3e5532c3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:08.861235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 845/1708] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:08 2022] DELETE /identity/v3/projects/9d5ae48f96964307be6229579f866fcd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:08.863779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114208-cea9-48df-a35b-d8396148df30 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:08.864686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114208-cea9-48df-a35b-d8396148df30 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:08.864983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114208-cea9-48df-a35b-d8396148df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:08.900736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-06114208-cea9-48df-a35b-d8396148df30 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:08.903667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-06114208-cea9-48df-a35b-d8396148df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:08.976677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:08.979195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:08.979744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:08.981563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] PATH_INFO: `/v3/users/a253ee9232f94475a74d4971b31722b7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:08.984415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a253ee9232f94475a74d4971b31722b7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:08.989453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:09.100142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 846/1709] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:09.102880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe53cc4-8d3f-4b78-b2ee-ef0fc0926847 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.103569 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe53cc4-8d3f-4b78-b2ee-ef0fc0926847 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.103873 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe53cc4-8d3f-4b78-b2ee-ef0fc0926847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.152034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4fe53cc4-8d3f-4b78-b2ee-ef0fc0926847 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:09.153850 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4fe53cc4-8d3f-4b78-b2ee-ef0fc0926847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.158980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:09.160520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:09.172570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a253ee9232f94475a74d4971b31722b7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.223281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a253ee9232f94475a74d4971b31722b7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.238670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a253ee9232f94475a74d4971b31722b7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.240392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a253ee9232f94475a74d4971b31722b7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.267660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fc91ac3a-69d7-453e-8797-68779fe61fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a253ee9232f94475a74d4971b31722b7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.309073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 864/1710] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:08 2022] DELETE /identity/v3/users/a253ee9232f94475a74d4971b31722b7 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:09.311052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6ad5e-f9c3-435e-bf27-dca687071861 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.311629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6ad5e-f9c3-435e-bf27-dca687071861 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.312043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6ad5e-f9c3-435e-bf27-dca687071861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.391213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 847/1711] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:10:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:09.394133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.394608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.395079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.419572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d3a6ad5e-f9c3-435e-bf27-dca687071861 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:09.420495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d3a6ad5e-f9c3-435e-bf27-dca687071861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.471302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:09.472630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.606680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 865/1712] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:09.614853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e3f3d-9609-4a92-9e79-77ca142d78c3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.615146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e3f3d-9609-4a92-9e79-77ca142d78c3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.616636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e3f3d-9609-4a92-9e79-77ca142d78c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.646388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 848/1713] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:09.647789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:09.652031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.656305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-af5e3f3d-9609-4a92-9e79-77ca142d78c3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:09.658682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-af5e3f3d-9609-4a92-9e79-77ca142d78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.673712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a1dc6-a016-49db-b9ed-9becfd6225fe None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:09.681611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 866/1714] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:09.683142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.683424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.683703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.691215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:09.692230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.692456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.692723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] PATH_INFO: `/v3/projects/7bb0f01046a74421918f80bdfcbb7846` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.695434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb0f01046a74421918f80bdfcbb7846)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:09.700766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:09.721088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:09.722812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.741790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 867/1715] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:09.746819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:09.764596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552a842-368a-4410-a23c-3400fe6350e9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:09.800511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:09.804055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:09.805478 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:09.806808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:09.810151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:09.811500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:09.813653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:09.848435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb0f01046a74421918f80bdfcbb7846', 'request_id': 'req-30e59340-26f7-453a-acf9-7c68e4957376'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.859148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 868/1716] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:09.860100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:09.867766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:09.870507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb0f01046a74421918f80bdfcbb7846', 'request_id': 'req-30e59340-26f7-453a-acf9-7c68e4957376'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.879994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb0f01046a74421918f80bdfcbb7846', 'request_id': 'req-30e59340-26f7-453a-acf9-7c68e4957376'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.897767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] The token cache is being invalidate because project 7bb0f01046a74421918f80bdfcbb7846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:09.898280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.898969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:09.905891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 849/1717] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:09 2022] DELETE /identity/v3/projects/7bb0f01046a74421918f80bdfcbb7846 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:09.907227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:09.908908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.002683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:10.068404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e59340-26f7-453a-acf9-7c68e4957376 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.075485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a27367-ff73-4134-b10d-ed25d059357f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.090559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.091746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.092242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.094793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.096121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:10.097403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.104641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.152402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 850/1718] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:10.153609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.158673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.165381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:10.222622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.223671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.224205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.224639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.247678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.256151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518e527-c52f-4b96-930d-63dc813a2fcd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.260678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.261413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.261635 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.261908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.264079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.282438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.284184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.297295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 851/1719] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:10.298592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.301087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.320987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9c0f1-1994-46ca-9fc9-c157c67c3eea service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.328253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfce0f-ab96-4033-914a-f0c20911c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.329845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfce0f-ab96-4033-914a-f0c20911c48c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.330471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfce0f-ab96-4033-914a-f0c20911c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.330901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfce0f-ab96-4033-914a-f0c20911c48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.331947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfce0f-ab96-4033-914a-f0c20911c48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.334337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfce0f-ab96-4033-914a-f0c20911c48c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.378537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.380442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.385130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 852/1720] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:10 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:10.386910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.387325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.387799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.407475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 869/1721] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:10:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:10:10.408779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.425013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc8c2-34e0-4af1-bd98-267b6065a6fd service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.464543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:10.466628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.558849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 853/1722] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:10.560651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.573636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904e509-023b-4056-aa3c-a1e5b900bd5f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.576771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.577539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.577800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.578108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.578813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.580953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.591117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a83ec-49a3-4bb2-a023-b3cf99958318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.593676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a83ec-49a3-4bb2-a023-b3cf99958318 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.595049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a83ec-49a3-4bb2-a023-b3cf99958318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.596287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a83ec-49a3-4bb2-a023-b3cf99958318 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.597237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a83ec-49a3-4bb2-a023-b3cf99958318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.602228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a83ec-49a3-4bb2-a023-b3cf99958318 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.653156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 854/1723] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:10 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:10.654666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.655241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.655678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.691074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:10.693385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:10.702194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 870/1724] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:10 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:10.717917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.737374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 855/1725] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:10.739749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.754508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17352e4-cc21-45ee-ab16-c8927cfb307c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.791512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:10.835539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.836687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.837176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.837508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.838600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.843112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.903776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 856/1726] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:10 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:10.904876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.924840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd847c-c8e2-43fe-9a5a-e6216f2af1a9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.934481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:10.945956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:10.946492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:10.946915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:10.948205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:10.948676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:10.951886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:10.969402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 857/1727] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:10.970872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:10.974949 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5be1-a930-4a99-b561-76dc2206b675 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:10.990517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9244-4582-44cc-af16-befcfef68b79 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.003499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.004390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.004725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.005003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.005986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.007712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.008686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.009613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.010047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.010504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.011425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.013325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.021454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 858/1728] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:11.022551 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.042929 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf9c1-d0e4-45f3-8c52-c36805562d37 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.058017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.058710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.058987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.059261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.060235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.061951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.064838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 871/1729] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:11.068817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.089444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:11.113692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46710ae6-421a-4b85-a817-bf5f116c7c18 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.137678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 859/1730] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:11 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:11.138877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.139820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.140251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.140447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.140870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.141771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.143798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.196068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 872/1731] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:11.197325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.238171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f010b8-f9de-4e26-a866-2860cf7b8812 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.566429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0083-211c-4b20-915f-1cb8b7f287b1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.593861 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.599329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.599329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.599631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.610646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.623623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.682680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 860/1732] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:11.682680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.717100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187463a-2e86-40e4-8666-3708933d23f8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.733519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.736502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.737059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.737158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.737544 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] PATH_INFO: `/v3/projects/0762ed7841ad41e9a67eae8f272e3b4c/users/6db4bc77be214d7ea2b8b519b43c18f1/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.738197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.739365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.739812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:11.740787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.742987 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.789182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0762ed7841ad41e9a67eae8f272e3b4c, user_id=6db4bc77be214d7ea2b8b519b43c18f1, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:11.792051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:11.793217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 873/1733] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:11 2022] POST /identity/v3/users => generated 303 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:11.794431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.825478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 861/1734] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:11 2022] PUT /identity/v3/projects/0762ed7841ad41e9a67eae8f272e3b4c/users/6db4bc77be214d7ea2b8b519b43c18f1/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:11.825478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:11.836413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060e31e-115c-428e-9e88-4db629e59ca5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:11.966482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:11.992427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c10ea-9aaf-4422-a4ad-f9978934ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:11.993705 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c10ea-9aaf-4422-a4ad-f9978934ed0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:11.994172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c10ea-9aaf-4422-a4ad-f9978934ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:11.994633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c10ea-9aaf-4422-a4ad-f9978934ed0b admin admin] PATH_INFO: `/v3/projects/7e010d26bf1f47b38559c57d190bed73/users/fbe382e5bd1e4c21bb6e7ff3808bd250/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.034047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c10ea-9aaf-4422-a4ad-f9978934ed0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e010d26bf1f47b38559c57d190bed73, user_id=fbe382e5bd1e4c21bb6e7ff3808bd250, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:12.041527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c10ea-9aaf-4422-a4ad-f9978934ed0b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:12.053893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814e332-a374-40f5-9a53-967f15ea22f9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:12.071301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 874/1735] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:11 2022] PUT /identity/v3/projects/7e010d26bf1f47b38559c57d190bed73/users/fbe382e5bd1e4c21bb6e7ff3808bd250/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:12.080068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.080444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.080784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.178073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] MFA Rules not processed for user `6db4bc77be214d7ea2b8b519b43c18f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:12.179329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:12.309884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8d52-34b0-432e-9dfe-087bf1e64d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:12.312637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8d52-34b0-432e-9dfe-087bf1e64d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.314284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8d52-34b0-432e-9dfe-087bf1e64d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.314877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8d52-34b0-432e-9dfe-087bf1e64d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.316501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8d52-34b0-432e-9dfe-087bf1e64d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:12.324135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8d52-34b0-432e-9dfe-087bf1e64d18 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:12.356887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 862/1736] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:12.366244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53833-e4e6-4ac1-be77-dfb040729c50 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.367017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53833-e4e6-4ac1-be77-dfb040729c50 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.367529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53833-e4e6-4ac1-be77-dfb040729c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.418000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:12.421501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bbd53833-e4e6-4ac1-be77-dfb040729c50 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:12.423039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bbd53833-e4e6-4ac1-be77-dfb040729c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:12.454276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 875/1737] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:12.458554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:12.459686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 863/1738] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:12.462727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.468262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.468882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.496208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ef132-67d1-4ed0-ab1f-c7f0e7ad963c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:12.517105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] MFA Rules not processed for user `d6e8bab40c4b4f029d9ac7600d756797`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:12.519921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:12.520641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.520927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.521207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.523891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:12.524169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:12.525568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:12.572236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 876/1739] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:12.574805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:12.607049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146dbf-ab93-4ade-888c-adbc85fa35bb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:12.611317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 864/1740] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Jun 24 07:10:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:12.612440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:12.614383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:12.625881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:12.630010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.630317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.630603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.631353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:12.632247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7ad5e-ed35-4c5b-b921-36e2915ba3ca None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:12.638872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:12.638872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.638872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.638872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.641698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:12.651086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:12.652744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:12.674107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 865/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:12.674978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:12.710414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3252f7f-3626-4178-a030-551fad9e9048 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:12.710690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 877/1742] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:12 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:12.715153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:12.852013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:12.853661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:12.854287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:12.854866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] PATH_INFO: `/v3/projects/f6d08e00a60844c088b0537f0d39e75a/users/1ed5302426f14718bc69664c71f7a607/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:12.893752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d08e00a60844c088b0537f0d39e75a, user_id=1ed5302426f14718bc69664c71f7a607, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:12.905506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:12.935455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:12.938466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ccf4c-67a0-46fd-bc5e-b72a4978dd8f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:12.941009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 866/1743] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:12 2022] PUT /identity/v3/projects/f6d08e00a60844c088b0537f0d39e75a/users/1ed5302426f14718bc69664c71f7a607/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:12.958791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.154589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab0a8-aaee-4357-901e-b2340e9670b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.155309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab0a8-aaee-4357-901e-b2340e9670b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.155593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab0a8-aaee-4357-901e-b2340e9670b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.155901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab0a8-aaee-4357-901e-b2340e9670b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.157057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab0a8-aaee-4357-901e-b2340e9670b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.159779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab0a8-aaee-4357-901e-b2340e9670b0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.200365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233a87-865a-4015-82e1-f3b7ceb9da84 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.214416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 878/1744] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:12 2022] POST /identity/v3/users => generated 295 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:13.217655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.217996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.218292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.218576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.218733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.219123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.219533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.239013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.241191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.262999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 867/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:13.264765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.283749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a743f8-7d2b-47d1-9cc0-8b4dc8a2f2fe service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.296943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.297802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.298192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.298587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.316129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.316945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] MFA Rules not processed for user `1ed5302426f14718bc69664c71f7a607`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:13.318822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:13.320740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.360214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 868/1746] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:13.361891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.415186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d039d-fea4-42f0-bcc5-b7d260b28746 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.427157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.429468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.433047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.433463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.434360 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.436148 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.471028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 869/1747] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:13.475639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.489063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382ea5-1d0b-41a0-a1bf-d04598e824a7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.494710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.496318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.496852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.497316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] PATH_INFO: `/v3/projects/113ee3f99ad84238908e7b1b46a9d9eb/users/166c1319603f4c30ba138ec3f1d8c146/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.542648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113ee3f99ad84238908e7b1b46a9d9eb, user_id=166c1319603f4c30ba138ec3f1d8c146, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.546060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.566815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:13.569944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 870/1748] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:13 2022] PUT /identity/v3/projects/113ee3f99ad84238908e7b1b46a9d9eb/users/166c1319603f4c30ba138ec3f1d8c146/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:13.573802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.635355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 879/1749] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:13.637994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.674099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539566-f564-47a2-bc8b-b85a57a84c57 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.699410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79d7b-b745-476f-96f0-2ab544cf2779 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.704914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.705705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.706103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.706598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.707546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.709359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.735524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 871/1750] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:13.736752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:13.753267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee79d-3023-4a5f-b49e-8d88981e6198 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:13.761307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881047d-b255-47db-b674-49260b85a439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.762491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881047d-b255-47db-b674-49260b85a439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.762845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881047d-b255-47db-b674-49260b85a439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.763607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881047d-b255-47db-b674-49260b85a439 admin admin] PATH_INFO: `/v3/projects/113ee3f99ad84238908e7b1b46a9d9eb/users/166c1319603f4c30ba138ec3f1d8c146/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.766026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881047d-b255-47db-b674-49260b85a439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113ee3f99ad84238908e7b1b46a9d9eb, user_id=166c1319603f4c30ba138ec3f1d8c146, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.771241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881047d-b255-47db-b674-49260b85a439 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.803963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 872/1751] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:13 2022] PUT /identity/v3/projects/113ee3f99ad84238908e7b1b46a9d9eb/users/166c1319603f4c30ba138ec3f1d8c146/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:13.806659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.807323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.807619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.857025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:13.857398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] MFA Rules not processed for user `166c1319603f4c30ba138ec3f1d8c146`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:13.857744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:13.858034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:13.858300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:13.859002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:13.859210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:13.861271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:13.900348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:13.944304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 880/1752] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:13 2022] POST /identity/v3/projects => generated 405 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:13.951069 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:14.109372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 873/1753] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:14.121274 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:14.124710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:14.213848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764609-18ab-41ba-865e-6cfffba3d551 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:14.232570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:14.236356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:14.237684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:14.237973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:14.238728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:14.240713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:14.308798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 881/1754] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:13 2022] POST /identity/v3/users => generated 309 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:14.311328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:14.320707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8bcd-3693-471c-b9db-001ddfbd9143 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:14.338669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895863b7-fc76-4cec-9dbf-e10745ec9335 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:14.355520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:14.356403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:14.356686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:14.356958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:14.359670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:14.364574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:14.404451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 882/1755] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:14.407577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:14.412289 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:14.454011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:14.454996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:14.455425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:14.455879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:14.456436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32aa1-60d7-4590-9a08-670072a5441b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:14.470665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:14.475439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:14.475732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:14.477863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] PATH_INFO: `/v3/projects/4d88556b060047ad90d5b8e7e0993c0b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:14.485635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d88556b060047ad90d5b8e7e0993c0b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:14.492924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:14.656503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:14.663608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:14.674398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:14.680856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 874/1756] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:10:14.681791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:14.683111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d88556b060047ad90d5b8e7e0993c0b', 'request_id': 'req-7228fd41-30ca-451d-a481-1aac2780de79'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:14.712931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d88556b060047ad90d5b8e7e0993c0b', 'request_id': 'req-7228fd41-30ca-451d-a481-1aac2780de79'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:14.720300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32b43-b8cb-4c99-914b-5e64c04f15b8 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:14.738659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d88556b060047ad90d5b8e7e0993c0b', 'request_id': 'req-7228fd41-30ca-451d-a481-1aac2780de79'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:14.769146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] The token cache is being invalidate because project 4d88556b060047ad90d5b8e7e0993c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:14.771582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:14.772944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:14.780575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 883/1757] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:14 2022] DELETE /identity/v3/projects/4d88556b060047ad90d5b8e7e0993c0b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:14.785764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:14.788537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:14.875411 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:15.041526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:15.042801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:15.043225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:15.043641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] PATH_INFO: `/v3/projects/f35d9feb1d2746d593ef8656838b2b5b/users/edd89ec14a9c4c9db847449beb3508e4/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:15.121365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35d9feb1d2746d593ef8656838b2b5b, user_id=edd89ec14a9c4c9db847449beb3508e4, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:15.131154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228fd41-30ca-451d-a481-1aac2780de79 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:15.146958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:15.164602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:15.165524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:15.165807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:15.166077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] PATH_INFO: `/v3/users/fcf35c1a3c2f44b8b26ff38941cf0996` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:15.175276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf35c1a3c2f44b8b26ff38941cf0996)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:15.183126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:15.208398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 875/1758] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:14 2022] PUT /identity/v3/projects/f35d9feb1d2746d593ef8656838b2b5b/users/edd89ec14a9c4c9db847449beb3508e4/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:15.220045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:15.250084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:15.364493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf35c1a3c2f44b8b26ff38941cf0996'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:15.409432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf35c1a3c2f44b8b26ff38941cf0996'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:15.424072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf35c1a3c2f44b8b26ff38941cf0996'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:15.424695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf35c1a3c2f44b8b26ff38941cf0996'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:15.436992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf35c1a3c2f44b8b26ff38941cf0996'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:15.449718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 884/1759] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:14 2022] DELETE /identity/v3/users/fcf35c1a3c2f44b8b26ff38941cf0996 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:15.502578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce03de-60bf-4bcb-81f8-2f2e93201ac9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:15.697821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34345c58-4993-4228-b1d9-c9f32019ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:15.698777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34345c58-4993-4228-b1d9-c9f32019ebd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:15.699204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34345c58-4993-4228-b1d9-c9f32019ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:15.699706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34345c58-4993-4228-b1d9-c9f32019ebd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:15.703212 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34345c58-4993-4228-b1d9-c9f32019ebd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:15.716958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34345c58-4993-4228-b1d9-c9f32019ebd5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:15.779014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 876/1760] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:15.780300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:15.782019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:15.822632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef479a7d-0950-498a-ab4f-85e3f14241e6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:15.854813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:15.856373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:15.856763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:15.857158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] PATH_INFO: `/v3/projects/f35d9feb1d2746d593ef8656838b2b5b/users/edd89ec14a9c4c9db847449beb3508e4/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:15.862530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35d9feb1d2746d593ef8656838b2b5b, user_id=edd89ec14a9c4c9db847449beb3508e4, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:15.873552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:15.915804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 885/1761] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:15 2022] PUT /identity/v3/projects/f35d9feb1d2746d593ef8656838b2b5b/users/edd89ec14a9c4c9db847449beb3508e4/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:15.923153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:15.923153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:15.923153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:15.961026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] MFA Rules not processed for user `edd89ec14a9c4c9db847449beb3508e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:15.962106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:16.078753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:16.121931 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 877/1762] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:16.132419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:16.135794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:16.245736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:16.310384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c244e3-e69b-4c16-93a8-15b72cc32b8d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:16.322447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94569e-3104-4324-b8f2-7292f9e3ed7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:16.323422 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94569e-3104-4324-b8f2-7292f9e3ed7b service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:16.323780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94569e-3104-4324-b8f2-7292f9e3ed7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:16.324369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94569e-3104-4324-b8f2-7292f9e3ed7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:16.348828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94569e-3104-4324-b8f2-7292f9e3ed7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:16.350766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94569e-3104-4324-b8f2-7292f9e3ed7b service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:16.403911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 886/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:16.683512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:16.823953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39922-e7cc-4562-ac86-ec60e8557859 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:16.836128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:16.838271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:16.838648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:16.839032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] PATH_INFO: `/v3/users/1ed5302426f14718bc69664c71f7a607` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:16.843740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed5302426f14718bc69664c71f7a607)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:16.845889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:16.989069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed5302426f14718bc69664c71f7a607'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.023829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed5302426f14718bc69664c71f7a607'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.036306 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed5302426f14718bc69664c71f7a607'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.037370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed5302426f14718bc69664c71f7a607'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.039041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed5302426f14718bc69664c71f7a607'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.069101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 878/1764] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:16 2022] DELETE /identity/v3/users/1ed5302426f14718bc69664c71f7a607 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:17.073954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:17.074724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:17.074830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:17.114398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:17.115930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:17.239492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:17.241969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:17.355618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 887/1765] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:17.447999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:17.450620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:17.481292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d6619-6c9a-486a-9d9b-53ccd05b6880 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:17.489101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:17.495260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:17.495757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:17.496285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] PATH_INFO: `/v3/projects/e625840c19864e8b93f2c96fe66cefb4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:17.499944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e625840c19864e8b93f2c96fe66cefb4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:17.504041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:17.536663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:17.675521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcfd41-3b95-416d-b904-b7f4ff4d8481 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:17.724880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e625840c19864e8b93f2c96fe66cefb4', 'request_id': 'req-770af49b-0a7f-49bb-a06a-6b0deeb43929'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.756968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e625840c19864e8b93f2c96fe66cefb4', 'request_id': 'req-770af49b-0a7f-49bb-a06a-6b0deeb43929'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.771384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e625840c19864e8b93f2c96fe66cefb4', 'request_id': 'req-770af49b-0a7f-49bb-a06a-6b0deeb43929'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.807115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330127c9-f00f-4c3f-b490-681ca8defb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:17.807858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330127c9-f00f-4c3f-b490-681ca8defb05 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:17.808153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330127c9-f00f-4c3f-b490-681ca8defb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:17.808646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330127c9-f00f-4c3f-b490-681ca8defb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:17.810167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] The token cache is being invalidate because project e625840c19864e8b93f2c96fe66cefb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:17.812140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.815165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-770af49b-0a7f-49bb-a06a-6b0deeb43929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:17.819565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 879/1766] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:17 2022] DELETE /identity/v3/projects/e625840c19864e8b93f2c96fe66cefb4 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:17.825012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:17.825649 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:17.825733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:17.876894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:17.881153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:17.929923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:17.971603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330127c9-f00f-4c3f-b490-681ca8defb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:17.976756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330127c9-f00f-4c3f-b490-681ca8defb05 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.025048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 888/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:18.066437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 880/1768] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:18.074748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.075071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.075312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.095756 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:18.097481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:18.121655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 889/1769] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:18.127406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.155760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c7ee7-2604-474e-9c89-4b50607d3cc7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.173927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.174629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.174978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.175261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.176205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:18.176412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.194734 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faad06-3390-40b4-b041-694b6ee4d92f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.222128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 881/1770] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:18.225255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.241320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2dc88-535e-44b7-84f1-514d6dbc2623 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.267518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.269726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.270243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.270677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.272492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.278174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.303369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd756b-aaf2-4d4e-a829-1884c68eb98f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.303369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd756b-aaf2-4d4e-a829-1884c68eb98f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.303676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd756b-aaf2-4d4e-a829-1884c68eb98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.368329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 890/1771] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:18.372685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.375651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0fdd756b-aaf2-4d4e-a829-1884c68eb98f None None] MFA Rules not processed for user `fbe382e5bd1e4c21bb6e7ff3808bd250`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:18.376913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0fdd756b-aaf2-4d4e-a829-1884c68eb98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:18.686970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245472-291f-4b11-8b6a-f9280e462eca admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.694400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 882/1772] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:18.697186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136021e3-4822-4a0c-9f4d-a194aa624056 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.697497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136021e3-4822-4a0c-9f4d-a194aa624056 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.697787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136021e3-4822-4a0c-9f4d-a194aa624056 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.716398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 883/1773] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:10:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:10:18.716398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136021e3-4822-4a0c-9f4d-a194aa624056 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.716704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb59c-80d9-4d36-bf30-dba5eeace6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.716704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb59c-80d9-4d36-bf30-dba5eeace6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.716704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb59c-80d9-4d36-bf30-dba5eeace6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.716704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb59c-80d9-4d36-bf30-dba5eeace6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.716988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb59c-80d9-4d36-bf30-dba5eeace6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.716988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb59c-80d9-4d36-bf30-dba5eeace6e8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.721318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-136021e3-4822-4a0c-9f4d-a194aa624056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:18.751074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136021e3-4822-4a0c-9f4d-a194aa624056 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.758441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 891/1774] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/users => generated 290 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:18.758640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.758640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.758818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.758893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.758991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.759066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.759226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.759302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.761127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.772796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:18.787413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:18.789906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:18.796229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 884/1775] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:18.796952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.875800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2e9-d0a2-4faf-b2bf-fdb2c91be508 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.881385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.882093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.882378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.882655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.883548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.885571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.887857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 892/1776] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:18.888926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.905615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f3174-522a-4e30-a32a-0977e54b93f0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.905922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 885/1777] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:18.907558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.911468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.912216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.912543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.913407 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.915304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.917818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.918927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff976c-357b-43ef-be0c-61ba12dad43c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.939943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.945101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.945464 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.945750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.946536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.948754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:18.959146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 893/1778] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:18 2022] POST /identity/v3/users => generated 309 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:18.959146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.965458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:18.968807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 886/1779] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:18.969614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:18.981389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609535fc-2144-454b-97df-67e42acfae1d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:18.986866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:18.987595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:18.987927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:18.988195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:18.989072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:18.990716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.006440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 887/1780] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:19.006440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.009500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:19.019203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c61cdd-ce75-4702-a3e8-7587ee37db0d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.024195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.025704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.026096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.026955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] PATH_INFO: `/v3/projects/a240fa6e636c46479567b33fadeab077/users/6d22098f05474364b98cbbf112f7ffde/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.045583 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a240fa6e636c46479567b33fadeab077, user_id=6d22098f05474364b98cbbf112f7ffde, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.048547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.069898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 888/1781] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:19 2022] PUT /identity/v3/projects/a240fa6e636c46479567b33fadeab077/users/6d22098f05474364b98cbbf112f7ffde/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:19.073045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.090954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d8876-e544-4e49-b2b1-14c30db6f693 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.165178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3973-d374-452f-bac8-182235457983 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.170316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.171414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.171806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.172136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] PATH_INFO: `/v3/projects/b5af236e11744f0988265f14a685de1b/users/f29dcd2578174d3ca622bb6536af91bf/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.184897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8ce4-d76c-4a63-a992-d0ca695005ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.185578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8ce4-d76c-4a63-a992-d0ca695005ad service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.185855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8ce4-d76c-4a63-a992-d0ca695005ad service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.186130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8ce4-d76c-4a63-a992-d0ca695005ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.196797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5af236e11744f0988265f14a685de1b, user_id=f29dcd2578174d3ca622bb6536af91bf, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.198321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a8ce4-d76c-4a63-a992-d0ca695005ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.200066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a8ce4-d76c-4a63-a992-d0ca695005ad service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.200494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.227594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 894/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:19.233393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.233682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.233991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.241670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 889/1783] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:19 2022] PUT /identity/v3/projects/b5af236e11744f0988265f14a685de1b/users/f29dcd2578174d3ca622bb6536af91bf/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:19.245587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.306468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] MFA Rules not processed for user `6d22098f05474364b98cbbf112f7ffde`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:19.307717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:19.316617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:19.405554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772087be-ed87-491f-a7bc-1053644220a1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.423226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.424032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.424417 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.425130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.425958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.428935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.483198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 890/1784] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:19.485919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.516569 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7877e19-738b-49e9-982a-430a4feb850d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.536737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.537964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.538256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.538531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] PATH_INFO: `/v3/projects/b5af236e11744f0988265f14a685de1b/users/f29dcd2578174d3ca622bb6536af91bf/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.540759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5af236e11744f0988265f14a685de1b, user_id=f29dcd2578174d3ca622bb6536af91bf, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.543568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.566557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 895/1785] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:19.571155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.575347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 891/1786] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:19 2022] PUT /identity/v3/projects/b5af236e11744f0988265f14a685de1b/users/f29dcd2578174d3ca622bb6536af91bf/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:19.601151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1a5fc-5492-450b-a3f6-1cbc3a4a41a5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.696400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.698249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:19.700388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:19.764804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.765539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.765807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.766198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.766854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.768878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:19.823740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 896/1787] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:19 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:19.827368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:19.842206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3425568-4f9e-440b-919f-1dd924315646 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:19.963384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:19.964527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:19.964856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:19.965195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] PATH_INFO: `/v3/projects/f6d08e00a60844c088b0537f0d39e75a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:19.967285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d08e00a60844c088b0537f0d39e75a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:19.969320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.015928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92034-c25d-490c-a0be-f6b48e22f3be admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.030227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.030932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.031212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.031484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.032281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:20.034642 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.060021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 897/1788] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:19 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:20.064008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:20.065472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d08e00a60844c088b0537f0d39e75a', 'request_id': 'req-f5616f06-4084-4c6e-a30e-f72b439eb601'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.074335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326ab7-6d99-479a-a6bf-1825a0378cbc admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.076644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:20.082263 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d08e00a60844c088b0537f0d39e75a', 'request_id': 'req-f5616f06-4084-4c6e-a30e-f72b439eb601'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.093005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d08e00a60844c088b0537f0d39e75a', 'request_id': 'req-f5616f06-4084-4c6e-a30e-f72b439eb601'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.106169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] The token cache is being invalidate because project f6d08e00a60844c088b0537f0d39e75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:20.106736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.108215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.110250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 892/1789] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:19 2022] DELETE /identity/v3/projects/f6d08e00a60844c088b0537f0d39e75a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:20.114321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:20.116558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:20.153073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.154359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.154830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.155316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.156438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:20.159064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.173563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 898/1790] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:20.177752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:20.180368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:20.198171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5616f06-4084-4c6e-a30e-f72b439eb601 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.198604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7298fe-491c-4a75-8ed7-651a0a23c1d6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.205711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.205930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.207087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.208115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.208492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] PATH_INFO: `/v3/users/edd89ec14a9c4c9db847449beb3508e4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.208592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.209044 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.209568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] PATH_INFO: `/v3/projects/7e840311a12142e29c1932436b11afcd/users/d4cacacc0c11465cabdc16fa7f23a6ca/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.210966 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd89ec14a9c4c9db847449beb3508e4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:20.212875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.267975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e840311a12142e29c1932436b11afcd, user_id=d4cacacc0c11465cabdc16fa7f23a6ca, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:20.271035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.310328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 899/1791] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:20 2022] PUT /identity/v3/projects/7e840311a12142e29c1932436b11afcd/users/d4cacacc0c11465cabdc16fa7f23a6ca/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:20.320436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:20.361367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd89ec14a9c4c9db847449beb3508e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.375393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:20.403378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd89ec14a9c4c9db847449beb3508e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.417878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd89ec14a9c4c9db847449beb3508e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.418934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd89ec14a9c4c9db847449beb3508e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.419863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd60fac8-2e68-48be-a2fd-a574f7bb569b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd89ec14a9c4c9db847449beb3508e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:20.435799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b1db-ca50-412e-b81e-0b4b01d4b97d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.441875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.443076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.443472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.443822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.444661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:20.446361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.455429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 893/1792] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:20 2022] DELETE /identity/v3/users/edd89ec14a9c4c9db847449beb3508e4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:20.457235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1b14-40b6-42d0-9dd5-cc163bd22238 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.457532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1b14-40b6-42d0-9dd5-cc163bd22238 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.457807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1b14-40b6-42d0-9dd5-cc163bd22238 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.460128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 900/1793] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:20.469195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:20.470200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 894/1794] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:10:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:10:20.483553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:20.518970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c513-c45f-41b9-997e-0067e4e032f0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.535059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a1b14-40b6-42d0-9dd5-cc163bd22238 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:20.537085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d92a1b14-40b6-42d0-9dd5-cc163bd22238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:20.626225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c70518-907d-40ea-ab79-97ba92266a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.627371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c70518-907d-40ea-ab79-97ba92266a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.627875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c70518-907d-40ea-ab79-97ba92266a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.628388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c70518-907d-40ea-ab79-97ba92266a3f admin admin] PATH_INFO: `/v3/projects/7e840311a12142e29c1932436b11afcd/users/d4cacacc0c11465cabdc16fa7f23a6ca/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.631300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c70518-907d-40ea-ab79-97ba92266a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e840311a12142e29c1932436b11afcd, user_id=d4cacacc0c11465cabdc16fa7f23a6ca, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:20.634781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c70518-907d-40ea-ab79-97ba92266a3f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:20.654645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 901/1795] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:20 2022] PUT /identity/v3/projects/7e840311a12142e29c1932436b11afcd/users/d4cacacc0c11465cabdc16fa7f23a6ca/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:20.657602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d9cae-70e6-4507-bb74-0cbac2b4345c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.658014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d9cae-70e6-4507-bb74-0cbac2b4345c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.658916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d9cae-70e6-4507-bb74-0cbac2b4345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.704536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-289d9cae-70e6-4507-bb74-0cbac2b4345c None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:20.706087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-289d9cae-70e6-4507-bb74-0cbac2b4345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:20.815406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a1b14-40b6-42d0-9dd5-cc163bd22238 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:20.859554 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:20.925363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 902/1796] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:10:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:20.926585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.926881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.927328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.988995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:20.990457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:20.990991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:20.991526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:20.993687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:20.996085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] MFA Rules not processed for user `d4cacacc0c11465cabdc16fa7f23a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:20.997421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.078095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:21.141587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.143211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.150675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 903/1797] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:21.152245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.153892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.168139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 895/1798] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:10:21.168418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.170076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.172875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407cca-f9f6-4610-8189-8e0abe727428 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.180329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.181231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.181630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.181996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.193874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.196601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.213165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 904/1799] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:21.214266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.215726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.233937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a3152-39fe-4fa1-80a2-e6aa9370c7c2 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.240817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303ec7-7fb9-4682-96b6-3cf3851a9c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.241876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303ec7-7fb9-4682-96b6-3cf3851a9c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.242265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303ec7-7fb9-4682-96b6-3cf3851a9c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.242635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303ec7-7fb9-4682-96b6-3cf3851a9c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.255201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303ec7-7fb9-4682-96b6-3cf3851a9c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.256962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303ec7-7fb9-4682-96b6-3cf3851a9c65 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.272450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 905/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:21.277294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f2a23-bd1c-4ea5-a445-4e402f153551 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.291081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.292151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.292431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.292703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] PATH_INFO: `/v3/projects/f35d9feb1d2746d593ef8656838b2b5b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.296655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35d9feb1d2746d593ef8656838b2b5b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.300542 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.375361 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35d9feb1d2746d593ef8656838b2b5b', 'request_id': 'req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:21.393175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35d9feb1d2746d593ef8656838b2b5b', 'request_id': 'req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:21.407190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35d9feb1d2746d593ef8656838b2b5b', 'request_id': 'req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:21.417738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:21.426225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] The token cache is being invalidate because project f35d9feb1d2746d593ef8656838b2b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:21.427402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:21.429169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c71dfa7f-bdd7-4d64-b769-d78955d8fa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:21.433248 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 896/1801] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:21 2022] DELETE /identity/v3/projects/f35d9feb1d2746d593ef8656838b2b5b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:21.438294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.438587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.438878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.469262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:21.470580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.584325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 906/1802] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:21.593258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.593650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.594140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.627172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:21.629092 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.647895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 897/1803] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:21.650017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.666846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca2d72-0885-4806-941e-fef9b940865d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.673076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.674034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.674486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.674951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.675905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:21.676209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.678022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.695081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 907/1804] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:21.700298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.715152 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0888-3b5d-4995-ac0e-1eb011c09cb8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.730820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.733305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.733718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.738418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.738418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.742499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.799554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.800100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 898/1805] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:21.811163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.813091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:21.824020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c253f0-94d4-4dd3-b7e1-2fdf962c0541 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.886682 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.887656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.887970 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.888243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.888942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.889530 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d27b05-3210-4893-aa31-1a2dfa70130f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.890901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.894399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4cacacc0c11465cabdc16fa7f23a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e840311a12142e29c1932436b11afcd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.895178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.895704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.896118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.896953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:21.897362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.899070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.914053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 899/1806] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:21.914806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 908/1807] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:21 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:21.917944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.918504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.929232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31883f-ad52-4472-a97b-3555adc46e2b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.929425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c53a6-2a52-49c1-a739-a91f945ba7f3 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.934309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.934481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4cacacc0c11465cabdc16fa7f23a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e840311a12142e29c1932436b11afcd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.935013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.935168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.935300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.935675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.935798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.935989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.937043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.937198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.938704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.939020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:21.952818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 909/1808] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:21.954241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.966738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad126e13-1494-42c5-bb58-fa519b6486ce admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:21.972851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 900/1809] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:21 2022] POST /identity/v3/projects => generated 353 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:21.976529 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:21.977100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:21.981279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:21.988411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:21.988709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:21.989951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:21.991810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.004712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:22.020923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 910/1810] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:22.021779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.039238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fb1a4-203a-4d0f-b7b1-a7dd696f79de admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.078005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2a40-2cbf-4395-8dcf-479abfd5f9ee tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.085435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4cacacc0c11465cabdc16fa7f23a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e840311a12142e29c1932436b11afcd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.086457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.087010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.087567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.088495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:22.088936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.090891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76b40-c7d3-43c9-aa23-c19dfd657c61 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.110150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 901/1811] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:22.111977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00066-4433-4adb-b416-4b15b1935321 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.112651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00066-4433-4adb-b416-4b15b1935321 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.113057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00066-4433-4adb-b416-4b15b1935321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.119957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.121292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.122589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.122943 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] PATH_INFO: `/v3/projects/7d9b88cd73274cc99486f1078fbf6829/users/fd26fc0e1f6b4f129f9729254e82c424/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.141175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9b88cd73274cc99486f1078fbf6829, user_id=fd26fc0e1f6b4f129f9729254e82c424, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.144958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.150091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a3f00066-4433-4adb-b416-4b15b1935321 None None] MFA Rules not processed for user `f29dcd2578174d3ca622bb6536af91bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:22.153202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3f00066-4433-4adb-b416-4b15b1935321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.162400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 911/1812] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:22 2022] PUT /identity/v3/projects/7d9b88cd73274cc99486f1078fbf6829/users/fd26fc0e1f6b4f129f9729254e82c424/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:22.163723 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.189526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:22.254321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99674-1349-406f-93b3-0cca0d79a578 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.260242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 902/1813] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:22.260773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4cacacc0c11465cabdc16fa7f23a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e840311a12142e29c1932436b11afcd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.261885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.262215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.262674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.263326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.263752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.264996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] PATH_INFO: `/v3/projects/f8cfa50469ec43fb9a74dfd018fb6468` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.266519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8cfa50469ec43fb9a74dfd018fb6468)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.268821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.298300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] MFA Rules not processed for user `fd26fc0e1f6b4f129f9729254e82c424`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:22.300447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.332586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cfa50469ec43fb9a74dfd018fb6468', 'request_id': 'req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.339563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cfa50469ec43fb9a74dfd018fb6468', 'request_id': 'req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.348506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cfa50469ec43fb9a74dfd018fb6468', 'request_id': 'req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.375818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] The token cache is being invalidate because project f8cfa50469ec43fb9a74dfd018fb6468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:22.376197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.377242 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.379145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 912/1814] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:22 2022] DELETE /identity/v3/projects/f8cfa50469ec43fb9a74dfd018fb6468 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:22.410159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 903/1815] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:22.414346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.417977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.436071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:22.499131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc5932-6c36-4cdc-b1f5-b9397b3a90d2 tempest-VolumeQuotaClassesTest-478912764 tempest-VolumeQuotaClassesTest-478912764-project-admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.504396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.505133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.505501 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.505783 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.507025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.517939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.546859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 913/1816] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:22 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:22.550993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.617988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.620370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.634223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831043fe-a87e-4843-b93d-0b57ea46431c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.690405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:22.698184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.698973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.699107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8093d-5c5f-4279-a08d-6c972e990ffe admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.699655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.700102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.701047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.703565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.704350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.705727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.706045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.706320 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] PATH_INFO: `/v3/users/6d22098f05474364b98cbbf112f7ffde` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.707645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d22098f05474364b98cbbf112f7ffde)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.709654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.735481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 904/1817] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:22 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:22.737676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.760209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a74061-3f75-4dc5-a121-e564a964a8cd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.765821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.766566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.766849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.767121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.767877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.773288 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.777767 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d22098f05474364b98cbbf112f7ffde'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.785451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 905/1818] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:10:22.793650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.801825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d22098f05474364b98cbbf112f7ffde'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.804340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3438f-5af1-4d6e-8e9e-b2e04053121f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.809173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.810033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.810372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.810617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] PATH_INFO: `/v3/projects/76d27d58b0c447fd92613b7e645addd8/users/dc82ab6222e948118779ff9451a02681/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.810945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d22098f05474364b98cbbf112f7ffde'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.811739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d22098f05474364b98cbbf112f7ffde'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.819649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-839db190-3836-4041-9ab5-362cf20e0d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d22098f05474364b98cbbf112f7ffde'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:22.826280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 914/1819] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:22 2022] DELETE /identity/v3/users/6d22098f05474364b98cbbf112f7ffde => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:22.828406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d27d58b0c447fd92613b7e645addd8, user_id=dc82ab6222e948118779ff9451a02681, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.830771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.831162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.831387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.831565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.851777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 906/1820] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:22 2022] PUT /identity/v3/projects/76d27d58b0c447fd92613b7e645addd8/users/dc82ab6222e948118779ff9451a02681/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:22.852195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:22.852195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.853717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.855354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.865894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:22.928219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 915/1821] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:22.936718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4417-e811-4f33-b832-870bd9ada18c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.941503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.942181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.942424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.942526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.942714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.943438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.945107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:22.945607 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:22.959870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 907/1822] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:22.964243 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:22.979989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf640ea-8587-4327-8ecd-7ae4f45d182c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:22.990518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c73dc8-cc73-40c3-b17d-0bdde63b5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:22.991714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c73dc8-cc73-40c3-b17d-0bdde63b5a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:22.992197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c73dc8-cc73-40c3-b17d-0bdde63b5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:22.992431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c73dc8-cc73-40c3-b17d-0bdde63b5a50 admin admin] PATH_INFO: `/v3/projects/76d27d58b0c447fd92613b7e645addd8/users/dc82ab6222e948118779ff9451a02681/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:22.995775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c73dc8-cc73-40c3-b17d-0bdde63b5a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d27d58b0c447fd92613b7e645addd8, user_id=dc82ab6222e948118779ff9451a02681, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:22.998505 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c73dc8-cc73-40c3-b17d-0bdde63b5a50 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:23.013874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 908/1823] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:22 2022] PUT /identity/v3/projects/76d27d58b0c447fd92613b7e645addd8/users/dc82ab6222e948118779ff9451a02681/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:23.023947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ed4-6c40-4660-ab3c-7c0516d666fe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.024241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ed4-6c40-4660-ab3c-7c0516d666fe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.024520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ed4-6c40-4660-ab3c-7c0516d666fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.036460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80b53-e38a-478f-97db-032f49218406 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:23.054227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a0d59ed4-6c40-4660-ab3c-7c0516d666fe None None] MFA Rules not processed for user `dc82ab6222e948118779ff9451a02681`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:23.055163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a0d59ed4-6c40-4660-ab3c-7c0516d666fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:23.096737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dddb2-8b7e-4110-8cb0-a14f268099ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:23.097404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dddb2-8b7e-4110-8cb0-a14f268099ff service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.097692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dddb2-8b7e-4110-8cb0-a14f268099ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.097961 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dddb2-8b7e-4110-8cb0-a14f268099ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.141472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 909/1824] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:23.141472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b774-761e-4e0f-a0b9-febc2bec8ba0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.141472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b774-761e-4e0f-a0b9-febc2bec8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.141472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b774-761e-4e0f-a0b9-febc2bec8ba0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.142207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 910/1825] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:10:23.150292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b774-761e-4e0f-a0b9-febc2bec8ba0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:23.152769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fd92b774-761e-4e0f-a0b9-febc2bec8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:23.165066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dddb2-8b7e-4110-8cb0-a14f268099ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:23.166522 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dddb2-8b7e-4110-8cb0-a14f268099ff service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:23.176505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 916/1826] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:23.178095 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.178482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.178866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.184403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:23.198982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] MFA Rules not processed for user `6637a4d8b7104d158d4d9952cc2a5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:23.201295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:23.257959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:23.272443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b774-761e-4e0f-a0b9-febc2bec8ba0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:23.278749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:23.279687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.280141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.280562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.296497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:23.298537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:23.321297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 911/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:23.383344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 917/1828] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:10:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:23.435657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:23.437181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:23.450708 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:23.470241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45b819-7a82-4eb0-9f1a-60b8ce398adb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:23.478963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582d99-b5c4-4d3b-9907-2aedddad1338 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:23.486225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:23.486225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.486225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.486225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] PATH_INFO: `/v3/users/fd26fc0e1f6b4f129f9729254e82c424` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.489227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd26fc0e1f6b4f129f9729254e82c424)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:23.489613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:23.499637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af6b5f-ca00-4e6e-aba0-689b1ae6deb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6637a4d8b7104d158d4d9952cc2a5216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:23.500351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6b5f-ca00-4e6e-aba0-689b1ae6deb3 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.500923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6b5f-ca00-4e6e-aba0-689b1ae6deb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.501201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6b5f-ca00-4e6e-aba0-689b1ae6deb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.523893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6b5f-ca00-4e6e-aba0-689b1ae6deb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:23.525529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6b5f-ca00-4e6e-aba0-689b1ae6deb3 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:23.557188 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 912/1829] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:23.656746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd26fc0e1f6b4f129f9729254e82c424'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:23.693733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd26fc0e1f6b4f129f9729254e82c424'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:23.710357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd26fc0e1f6b4f129f9729254e82c424'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:23.711046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd26fc0e1f6b4f129f9729254e82c424'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:23.725690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd26fc0e1f6b4f129f9729254e82c424'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:23.735981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 918/1830] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:23 2022] DELETE /identity/v3/users/fd26fc0e1f6b4f129f9729254e82c424 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:23.742083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:23.742083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:23.742083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:23.785023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:23.787093 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:23.822945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:23.824785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:23.989541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 913/1831] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:24.027960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.040654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.137168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d39958-1aaa-43df-b127-a601c1c35e3d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:24.152982 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:24.154115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:24.154546 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:24.154975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] PATH_INFO: `/v3/projects/a240fa6e636c46479567b33fadeab077` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:24.158051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a240fa6e636c46479567b33fadeab077)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:24.168094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:24.229479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:24.240336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d52f8a-8afe-4c59-ab9c-daa3da8418c2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:24.262492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a240fa6e636c46479567b33fadeab077', 'request_id': 'req-61d9f18f-e8f8-4134-a611-1dda976e42e0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.272183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a240fa6e636c46479567b33fadeab077', 'request_id': 'req-61d9f18f-e8f8-4134-a611-1dda976e42e0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.278668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a240fa6e636c46479567b33fadeab077', 'request_id': 'req-61d9f18f-e8f8-4134-a611-1dda976e42e0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.301454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] The token cache is being invalidate because project a240fa6e636c46479567b33fadeab077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:24.301796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.302540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.304275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 919/1832] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:23 2022] DELETE /identity/v3/projects/a240fa6e636c46479567b33fadeab077 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:24.305203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.306597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.338968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:24.340950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:24.344503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:24.344793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:24.353603 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.402367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9f18f-e8f8-4134-a611-1dda976e42e0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:24.403385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:24.411333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:24.412840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:24.413279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:24.413559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] PATH_INFO: `/v3/users/fbe382e5bd1e4c21bb6e7ff3808bd250` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:24.414791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe382e5bd1e4c21bb6e7ff3808bd250)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:24.416983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:24.463796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:24.465524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:24.473599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe382e5bd1e4c21bb6e7ff3808bd250'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.476490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 914/1833] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:10:24.477371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.479048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.486144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe382e5bd1e4c21bb6e7ff3808bd250'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.490602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363a32-2bdf-41f5-912f-ff779f5b853f service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:24.494678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe382e5bd1e4c21bb6e7ff3808bd250'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.495663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe382e5bd1e4c21bb6e7ff3808bd250'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.497479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:24.498401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:24.498679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:24.498945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] PATH_INFO: `/v3/users/d4cacacc0c11465cabdc16fa7f23a6ca` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:24.500431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4cacacc0c11465cabdc16fa7f23a6ca)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:24.502409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:24.503730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe382e5bd1e4c21bb6e7ff3808bd250'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.510061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 920/1834] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:24 2022] DELETE /identity/v3/users/fbe382e5bd1e4c21bb6e7ff3808bd250 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:24.567032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4cacacc0c11465cabdc16fa7f23a6ca'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.581884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4cacacc0c11465cabdc16fa7f23a6ca'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.590843 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4cacacc0c11465cabdc16fa7f23a6ca'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.591566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4cacacc0c11465cabdc16fa7f23a6ca'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.592798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4cacacc0c11465cabdc16fa7f23a6ca'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.610236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 915/1835] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:24 2022] DELETE /identity/v3/users/d4cacacc0c11465cabdc16fa7f23a6ca => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:24.743209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.744993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.761910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.763474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.816221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:24.844966 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953b901-8996-4d06-af11-b59ac70f3286 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:24.858262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:24.859029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32640-3ffe-4a83-861f-b1bc904881c3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:24.859149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:24.859425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:24.859695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] PATH_INFO: `/v3/projects/7e010d26bf1f47b38559c57d190bed73` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:24.860949 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e010d26bf1f47b38559c57d190bed73)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:24.863081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:24.863914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:24.864797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:24.865073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:24.865344 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] PATH_INFO: `/v3/projects/7d9b88cd73274cc99486f1078fbf6829` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:24.866561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9b88cd73274cc99486f1078fbf6829)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:24.868538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:24.914933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:24.937979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e010d26bf1f47b38559c57d190bed73', 'request_id': 'req-2321230c-9aee-44fd-afc3-ba1e8cdaf407'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.942011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9b88cd73274cc99486f1078fbf6829', 'request_id': 'req-720bf85e-b54a-400d-9e94-b21bc514ab86'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.950518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e010d26bf1f47b38559c57d190bed73', 'request_id': 'req-2321230c-9aee-44fd-afc3-ba1e8cdaf407'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.953736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9b88cd73274cc99486f1078fbf6829', 'request_id': 'req-720bf85e-b54a-400d-9e94-b21bc514ab86'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.959828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e010d26bf1f47b38559c57d190bed73', 'request_id': 'req-2321230c-9aee-44fd-afc3-ba1e8cdaf407'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.963594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9b88cd73274cc99486f1078fbf6829', 'request_id': 'req-720bf85e-b54a-400d-9e94-b21bc514ab86'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.979641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] The token cache is being invalidate because project 7d9b88cd73274cc99486f1078fbf6829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:24.980454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.980725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.982301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 916/1836] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:24 2022] DELETE /identity/v3/projects/7d9b88cd73274cc99486f1078fbf6829 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:24.985467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] The token cache is being invalidate because project 7e010d26bf1f47b38559c57d190bed73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:24.985467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.985467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:24.986255 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.988202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:24.991727 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 921/1837] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:24 2022] DELETE /identity/v3/projects/7e010d26bf1f47b38559c57d190bed73 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:24.995580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:24.998187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.079907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf85e-b54a-400d-9e94-b21bc514ab86 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.084643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.085532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.085811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.086085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] PATH_INFO: `/v3/users/dc82ab6222e948118779ff9451a02681` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.087205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321230c-9aee-44fd-afc3-ba1e8cdaf407 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.087326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc82ab6222e948118779ff9451a02681)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.089251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.092505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.093468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.093815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.094151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] PATH_INFO: `/v3/users/f29dcd2578174d3ca622bb6536af91bf` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.095431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29dcd2578174d3ca622bb6536af91bf)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.097568 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.140318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc82ab6222e948118779ff9451a02681'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.150536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29dcd2578174d3ca622bb6536af91bf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.153414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc82ab6222e948118779ff9451a02681'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.161870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc82ab6222e948118779ff9451a02681'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.162559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc82ab6222e948118779ff9451a02681'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.163216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29dcd2578174d3ca622bb6536af91bf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.164779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc82ab6222e948118779ff9451a02681'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.173656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29dcd2578174d3ca622bb6536af91bf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.174960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29dcd2578174d3ca622bb6536af91bf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.177742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:25.178992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 917/1838] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:24 2022] DELETE /identity/v3/users/dc82ab6222e948118779ff9451a02681 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:25.182596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.184095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.199188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29dcd2578174d3ca622bb6536af91bf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.206448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 922/1839] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:24 2022] DELETE /identity/v3/users/f29dcd2578174d3ca622bb6536af91bf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:25.238376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:25.272126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff676-86e8-4ccc-957f-97439d79f5cf admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.343190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.344120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.344424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.344827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] PATH_INFO: `/v3/projects/7e840311a12142e29c1932436b11afcd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.346832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e840311a12142e29c1932436b11afcd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.349525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.397972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.400590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.418133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fae5-c664-493a-adfd-931d7fa34f19 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.423836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.424893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.425801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.426083 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] PATH_INFO: `/v3/projects/b5af236e11744f0988265f14a685de1b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.427383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5af236e11744f0988265f14a685de1b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.429537 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.467015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e840311a12142e29c1932436b11afcd', 'request_id': 'req-01803fef-eb4c-46c5-a589-8d95a3b46f15'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.476433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e840311a12142e29c1932436b11afcd', 'request_id': 'req-01803fef-eb4c-46c5-a589-8d95a3b46f15'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.486789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e840311a12142e29c1932436b11afcd', 'request_id': 'req-01803fef-eb4c-46c5-a589-8d95a3b46f15'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.492718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5af236e11744f0988265f14a685de1b', 'request_id': 'req-2c92f391-e8fa-48a9-9cce-aa36981a1654'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.499679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5af236e11744f0988265f14a685de1b', 'request_id': 'req-2c92f391-e8fa-48a9-9cce-aa36981a1654'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.505919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5af236e11744f0988265f14a685de1b', 'request_id': 'req-2c92f391-e8fa-48a9-9cce-aa36981a1654'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.507571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] The token cache is being invalidate because project 7e840311a12142e29c1932436b11afcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:25.508109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.509117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01803fef-eb4c-46c5-a589-8d95a3b46f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.512538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 918/1840] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:25 2022] DELETE /identity/v3/projects/7e840311a12142e29c1932436b11afcd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:25.518117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.518876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.519299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.525163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] The token cache is being invalidate because project b5af236e11744f0988265f14a685de1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:25.525163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.525936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2c92f391-e8fa-48a9-9cce-aa36981a1654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.531076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 923/1841] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:25 2022] DELETE /identity/v3/projects/b5af236e11744f0988265f14a685de1b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:25.532788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612881-838c-4640-8b69-56d720ed172e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.533075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612881-838c-4640-8b69-56d720ed172e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.533356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612881-838c-4640-8b69-56d720ed172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.546329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:25.548373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.555985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3d612881-838c-4640-8b69-56d720ed172e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:25.557197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3d612881-838c-4640-8b69-56d720ed172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.622789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 919/1842] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:25.623959 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.630513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.642165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 924/1843] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:25.644969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01535447-eb16-4a07-abf7-a863dac6a69b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.645525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01535447-eb16-4a07-abf7-a863dac6a69b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.645992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01535447-eb16-4a07-abf7-a863dac6a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.656611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883d852-fe20-4ab3-aed1-d90bfc3ae1bf None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.663365 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.664527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.664880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.665225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] PATH_INFO: `/v3/projects/76d27d58b0c447fd92613b7e645addd8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.668234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d27d58b0c447fd92613b7e645addd8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.678991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-01535447-eb16-4a07-abf7-a863dac6a69b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:25.679434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.680876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-01535447-eb16-4a07-abf7-a863dac6a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.692334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 925/1844] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:25.693566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:25.694268 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.694676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.695089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.713868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:25.715065 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.723955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 926/1845] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:25.723955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.736424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeddcfd-bd85-4795-b513-40d570f80a68 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.741677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d27d58b0c447fd92613b7e645addd8', 'request_id': 'req-f0db7072-4fc6-4385-aa29-c78246a92d67'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.749644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d27d58b0c447fd92613b7e645addd8', 'request_id': 'req-f0db7072-4fc6-4385-aa29-c78246a92d67'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.756082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d27d58b0c447fd92613b7e645addd8', 'request_id': 'req-f0db7072-4fc6-4385-aa29-c78246a92d67'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.766389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] The token cache is being invalidate because project 76d27d58b0c447fd92613b7e645addd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:25.766669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.767324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:25.768983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 920/1846] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:25 2022] DELETE /identity/v3/projects/76d27d58b0c447fd92613b7e645addd8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:25.769814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.771053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.792271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.792933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.793214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.793488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.794205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:25.794508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.796140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d8d9-27f1-4da8-bfd1-5794a7a77fbd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.798483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:25.808788 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 927/1847] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:25.810136 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.810706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.811288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.830644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:25.831872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.835060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db7072-4fc6-4385-aa29-c78246a92d67 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.839574 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.839874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 928/1848] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:25.840265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.840543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.840634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.840885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.841728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:25.841862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.842040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.843728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d05e2-59e6-4f17-aa44-d873860bd705 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.853805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031cd1a-9313-4c03-b891-e0b819961e51 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.859892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 921/1849] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:25.859892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.859892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.859892 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.862031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.862672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.862952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.863223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.863947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.865837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.876414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:25.877609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:25.886330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 922/1850] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:25.886974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.895709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 929/1851] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:25.895709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.900225 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe2c3-8cbb-4944-979f-073d109979f5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.957890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ed20-6a21-4584-b696-e5cf8c6d8794 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.958863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.959586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.959834 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.960141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.960805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.962717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.963066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.963693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.964107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.964477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.965213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:25.965505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.967313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:25.983502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 930/1852] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:25.983502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.990398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5a8da-8feb-4e1e-9dfa-9d2395f0a47a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:25.995013 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:25.995661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:25.996046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:25.996321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:25.997007 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:25.997482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 923/1853] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:25.998290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:25.998903 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.011584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:26.020365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 931/1854] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:26.023939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.033550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629d2c2-2a13-446f-ac5d-8befa4ee1658 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.071492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd144-685b-4a9d-a4c7-bd5e0ca06038 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.076270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.076941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.077227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.077502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.078221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.080160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.096632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.097270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.097551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.097837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.098582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.100530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.108065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 924/1855] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:25 2022] POST /identity/v3/projects => generated 409 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:26.109035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.127439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 932/1856] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:26 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:26.127439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.135770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abd79d-2914-4979-8373-ba78e0fd557a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.168684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:26.176066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b316d-3b1d-4c03-b5e5-9437c3405ccb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.191888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.192991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.193358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.193716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.194549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.197328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.223112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.224236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.224616 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.224978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.225758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.228483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.259949 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 925/1857] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:26.261025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.266010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 933/1858] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:26 2022] POST /identity/v3/users => generated 305 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:26.267314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.278480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115823b-d29e-4b0e-a906-2634edb39872 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.281086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233ce3-5c4b-43b4-afe2-52e2a3fe4da5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.283136 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.283835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.284349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.284828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.285991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.288050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.300612 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 926/1859] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:26.302085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.308206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.308206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.308206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.308206 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.308595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.308595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.313359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5617-da47-435d-8edc-67839f93fa04 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.319322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.320168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.320450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.320799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.321742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 934/1860] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:26.321869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.323505 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.325600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.335933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec5342-be75-44cb-b769-5fb45556e922 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.338175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 927/1861] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:26.339021 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.341094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.341846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.342449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.342786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.343589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.345318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.353916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd1e4-c43b-4f81-b188-03db4945a476 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.358385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 935/1862] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:26.359335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.361711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.363022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.363369 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.363778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] PATH_INFO: `/v3/projects/c0e39586223b48ef8540c33c91ab3c14/users/4f1c738a5b614d9b814492559c72adf1/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.375464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408802a-390a-4adb-afc5-fc5c0dd843f8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.387711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.388757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.389241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.389542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.390374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.392567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.399786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e39586223b48ef8540c33c91ab3c14, user_id=4f1c738a5b614d9b814492559c72adf1, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.410144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 936/1863] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:26.411059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.413584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.422570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c8b3f-04a6-44d8-9c9a-0f1f26db1820 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.427837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a359a-3068-4bcc-88fc-722012c914bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.428917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a359a-3068-4bcc-88fc-722012c914bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.429263 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a359a-3068-4bcc-88fc-722012c914bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.429536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a359a-3068-4bcc-88fc-722012c914bb admin admin] PATH_INFO: `/v3/projects/92683e5f5f12499db7a223af31ff8a16/users/59e905d1a67a4551841d24a8d3fca16a/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.450594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a359a-3068-4bcc-88fc-722012c914bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92683e5f5f12499db7a223af31ff8a16, user_id=59e905d1a67a4551841d24a8d3fca16a, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.452151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 928/1864] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:26 2022] PUT /identity/v3/projects/c0e39586223b48ef8540c33c91ab3c14/users/4f1c738a5b614d9b814492559c72adf1/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:26.453219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.457153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a359a-3068-4bcc-88fc-722012c914bb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.479890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 937/1865] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:26 2022] PUT /identity/v3/projects/92683e5f5f12499db7a223af31ff8a16/users/59e905d1a67a4551841d24a8d3fca16a/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:26.479890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc2451-55f5-4dac-b0cc-94ed89691c5a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.479890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc2451-55f5-4dac-b0cc-94ed89691c5a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.479890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc2451-55f5-4dac-b0cc-94ed89691c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.531436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:26.532418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d4dc2451-55f5-4dac-b0cc-94ed89691c5a None None] MFA Rules not processed for user `4f1c738a5b614d9b814492559c72adf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:26.533995 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d4dc2451-55f5-4dac-b0cc-94ed89691c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:26.571184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4b2a-6ab5-4e68-b775-3defd49b90f1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.628794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 938/1866] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:26.628794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88813494-d86f-4a74-b1ac-3d46cad7370c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.628794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88813494-d86f-4a74-b1ac-3d46cad7370c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.628794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88813494-d86f-4a74-b1ac-3d46cad7370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.639694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.640717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.640996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.641328 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] PATH_INFO: `/v3/projects/c4d6e6765d5c4fb4a069cd0239567f1e/users/6259dd3a7f0f455aa190d063cdc55efb/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.656689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d6e6765d5c4fb4a069cd0239567f1e, user_id=6259dd3a7f0f455aa190d063cdc55efb, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.659428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.671894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-88813494-d86f-4a74-b1ac-3d46cad7370c None None] MFA Rules not processed for user `59e905d1a67a4551841d24a8d3fca16a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:26.673117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-88813494-d86f-4a74-b1ac-3d46cad7370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:26.683950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 929/1867] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:26 2022] PUT /identity/v3/projects/c4d6e6765d5c4fb4a069cd0239567f1e/users/6259dd3a7f0f455aa190d063cdc55efb/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:26.685096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.687310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:26.779914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb463-ee84-430c-bcd8-9531eb836d72 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:26.781908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:26.786691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:26.787961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.788981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.789604 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.840842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 939/1868] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:26.842358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:26.842649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:26.842998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:26.865866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:26.868343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:26.880386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 930/1869] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:26.881140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:26.904585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] MFA Rules not processed for user `6259dd3a7f0f455aa190d063cdc55efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:26.905858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:26.933920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:27.030101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 940/1870] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:27.031002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.035496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a4a6f-8edb-473b-9e6f-c617c8565bdf service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.054807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.055969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.056403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.056852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.065081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a262-3d65-40d2-8fbc-d38aae085fe9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.069445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.072894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.073806 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.074271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.074563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] PATH_INFO: `/v3/users/4f1c738a5b614d9b814492559c72adf1` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.077660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.082071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1c738a5b614d9b814492559c72adf1)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.084539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.126708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 931/1871] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:26 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:27.128107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.177111 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1c738a5b614d9b814492559c72adf1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.192121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1c738a5b614d9b814492559c72adf1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.202343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1c738a5b614d9b814492559c72adf1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.203534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1c738a5b614d9b814492559c72adf1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.213428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1c738a5b614d9b814492559c72adf1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.223015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e57a65-d8e5-49ad-8d34-18a992d218a7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.228782 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 941/1872] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:27 2022] DELETE /identity/v3/users/4f1c738a5b614d9b814492559c72adf1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:27.229874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.231740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.231902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ffba8-8c0c-4b62-8a36-a2870322aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.232742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ffba8-8c0c-4b62-8a36-a2870322aee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.233440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ffba8-8c0c-4b62-8a36-a2870322aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.233975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ffba8-8c0c-4b62-8a36-a2870322aee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.235049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ffba8-8c0c-4b62-8a36-a2870322aee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.238999 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ffba8-8c0c-4b62-8a36-a2870322aee7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.307948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 932/1873] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:27 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:27.310183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.310528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.310933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.320227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:27.332567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:27.334192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.336214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7884-f781-443d-92a4-25adeb84a6d6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.411387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.412107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.412467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.412661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.416096 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 933/1874] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:27.416225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.416317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.416397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.417921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.434067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01d8b2-93be-48cd-ba8d-0ab9044cef97 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.439349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.440063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.440400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.440675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.441368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.443275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.443740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 942/1875] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:27 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:27.444722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.446332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.467217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 934/1876] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:27 2022] POST /identity/v3/users => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:27.467217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.474361 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904062a-b2c0-421a-8769-b263aca1ace7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.479162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.479802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.480109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.480379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.481095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.482666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.492751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 935/1877] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:27.493788 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.503309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e3399-9f8d-40ae-b789-7a1748cef664 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.507811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.508481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.508587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394cdb-ae7a-49c7-9a24-c6e1b7afb200 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.508758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.509029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.509738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.511305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.512132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.512780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.513053 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.513326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.523424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.525059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.536126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 943/1878] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:27.536770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.547932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fe7c-9a41-4be2-bb90-6b6c2222f382 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.553435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.554376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.555018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.555018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] PATH_INFO: `/v3/projects/028e1f4cbd814c45bfc44e319e53bb54/users/d4409c3da6cb41f28fbc7a9bb63887c5/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.573536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028e1f4cbd814c45bfc44e319e53bb54, user_id=d4409c3da6cb41f28fbc7a9bb63887c5, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.576414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.599447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 944/1879] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:27 2022] PUT /identity/v3/projects/028e1f4cbd814c45bfc44e319e53bb54/users/d4409c3da6cb41f28fbc7a9bb63887c5/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:27.600858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.645007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 936/1880] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:27.650065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.655464 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:27.663084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12e0f3-d4fa-447d-b1aa-ae7e76475f4e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.675123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4d985-d130-4474-8086-86c5704d5311 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.679930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.680933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.681370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.681780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.682654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.684445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.687283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:27.699506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 945/1881] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:27.702591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.717681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962f135-369b-48e2-a8d8-f893b90b78d4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.723663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fd5f5-37ce-459d-9734-e66cceab06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.724745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fd5f5-37ce-459d-9734-e66cceab06aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.725302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fd5f5-37ce-459d-9734-e66cceab06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.725302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fd5f5-37ce-459d-9734-e66cceab06aa admin admin] PATH_INFO: `/v3/projects/028e1f4cbd814c45bfc44e319e53bb54/users/d4409c3da6cb41f28fbc7a9bb63887c5/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.727309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fd5f5-37ce-459d-9734-e66cceab06aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=028e1f4cbd814c45bfc44e319e53bb54, user_id=d4409c3da6cb41f28fbc7a9bb63887c5, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.730359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fd5f5-37ce-459d-9734-e66cceab06aa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.737958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.738909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.739189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.739455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] PATH_INFO: `/v3/projects/b2b6b07ad24c40d4b186dbd7347605d2/users/ed5428f696fe4c8891de8c83a0ac938f/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.742164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 946/1882] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:27 2022] PUT /identity/v3/projects/028e1f4cbd814c45bfc44e319e53bb54/users/d4409c3da6cb41f28fbc7a9bb63887c5/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:27.751974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.752348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.752731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.764688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b6b07ad24c40d4b186dbd7347605d2, user_id=ed5428f696fe4c8891de8c83a0ac938f, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.767376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.781990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] MFA Rules not processed for user `d4409c3da6cb41f28fbc7a9bb63887c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:27.783223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.783971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 937/1883] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:27 2022] PUT /identity/v3/projects/b2b6b07ad24c40d4b186dbd7347605d2/users/ed5428f696fe4c8891de8c83a0ac938f/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:27.787456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.857018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9feea3-1ca5-4a20-bb4c-60bce77bbe05 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.862154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.862840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.863118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.863390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.864278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.865527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 947/1884] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:27.866313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.867949 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.872373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.882119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c3dc5-8600-4dbf-9bd5-1871b64dae68 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.883819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 938/1885] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:10:27.884552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.886168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.890211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.891122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.891602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.891978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] PATH_INFO: `/v3/projects/c0e39586223b48ef8540c33c91ab3c14` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.894313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e39586223b48ef8540c33c91ab3c14)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:27.896476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:27.943570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a152bc-d35c-4a0e-84fc-f5f969cab1a1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:27.944669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e39586223b48ef8540c33c91ab3c14', 'request_id': 'req-bcef6261-381c-4409-9c2b-4f025cb37c92'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.951299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e39586223b48ef8540c33c91ab3c14', 'request_id': 'req-bcef6261-381c-4409-9c2b-4f025cb37c92'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.956754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e39586223b48ef8540c33c91ab3c14', 'request_id': 'req-bcef6261-381c-4409-9c2b-4f025cb37c92'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.969925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] The token cache is being invalidate because project c0e39586223b48ef8540c33c91ab3c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:27.970235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.970893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:27.972563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 948/1886] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:27 2022] DELETE /identity/v3/projects/c0e39586223b48ef8540c33c91ab3c14 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:27.973309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:27.974610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:27.979945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:27.996227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:27.996900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:27.997178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:27.997450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:27.999249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.029596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:28.046549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6261-381c-4409-9c2b-4f025cb37c92 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.052241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2389-b84b-4595-ad22-4225a62c23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.053147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2389-b84b-4595-ad22-4225a62c23c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.053426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2389-b84b-4595-ad22-4225a62c23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.053702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2389-b84b-4595-ad22-4225a62c23c1 admin admin] PATH_INFO: `/v3/projects/b2b6b07ad24c40d4b186dbd7347605d2/users/ed5428f696fe4c8891de8c83a0ac938f/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.055656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe2389-b84b-4595-ad22-4225a62c23c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b6b07ad24c40d4b186dbd7347605d2, user_id=ed5428f696fe4c8891de8c83a0ac938f, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.058346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe2389-b84b-4595-ad22-4225a62c23c1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.067277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.068774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607da7fb-300d-4367-aa83-add18575a434 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.080260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 949/1887] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:27 2022] PUT /identity/v3/projects/b2b6b07ad24c40d4b186dbd7347605d2/users/ed5428f696fe4c8891de8c83a0ac938f/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:28.080260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6f63f-b415-46a9-ba58-9b521373e33a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.080260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6f63f-b415-46a9-ba58-9b521373e33a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.080260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6f63f-b415-46a9-ba58-9b521373e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.088798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 939/1888] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:28.090132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.091899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.092193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.094113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e1e6f63f-b415-46a9-ba58-9b521373e33a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:28.095401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e1e6f63f-b415-46a9-ba58-9b521373e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.133754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] MFA Rules not processed for user `ed5428f696fe4c8891de8c83a0ac938f`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:28.133754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.177291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 950/1889] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:28.185679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.186033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.186380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.206911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:28.208151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.217387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 951/1890] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:28.220900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.220900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.226447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 940/1891] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:28.227294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.240392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf0a7-8746-4f01-9b12-2b17266146ee None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.245118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.245771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.246113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.246389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.247119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:28.247424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.249065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.263386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 941/1892] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:28.267951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.270335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.294253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b581a7-d57e-43c6-a96f-489a545ca4f0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.299243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.299795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.300185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.300459 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.303023 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.339199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28478f-a36b-41c9-9236-5d54a7047f2b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.345754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.346446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.346729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.346997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.356665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.358086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.368043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 942/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:28.373731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.374797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.375527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.380905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:28.386597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 952/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:28.388480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7338-5840-4c11-a9bf-1ee28a2c0ddd service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.394747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.395704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.396016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.396291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.396988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.399054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.435878 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 943/1895] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:28 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:28.437443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.452702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a5604-c8f2-4fa1-81c9-f4e0584681c8 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.509038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:28.538424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.539145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.539427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.539740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.540617 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.542677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.576848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 953/1896] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:28 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:28.581532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.598702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de8b1-2e79-40a8-8524-eaaf55d3fd4c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.611619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.615927 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.617591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.617896 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.618656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.629745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.642480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 944/1897] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:28.646792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.649523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.657947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612744-7242-46d8-b43c-ebe010ec3a57 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.662827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.663740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.663924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.664188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.664857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.666548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.677059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 954/1898] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:28.681296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.691402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32b43-6af4-4b97-a070-a6418583721e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.696768 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc2790-4e87-4b16-abbd-8dcd9a4d98a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.697608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc2790-4e87-4b16-abbd-8dcd9a4d98a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.697910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc2790-4e87-4b16-abbd-8dcd9a4d98a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.698184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc2790-4e87-4b16-abbd-8dcd9a4d98a3 admin admin] PATH_INFO: `/v3/projects/0a2609dfd2ab4cfc868134370967eb54/users/def85b0e1ffa48e69043252bf04d6b96/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.707100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e8dc7-acf9-46b5-8b0e-da81bc9fcea0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.710937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.711591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.711902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.712180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.713602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc2790-4e87-4b16-abbd-8dcd9a4d98a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2609dfd2ab4cfc868134370967eb54, user_id=def85b0e1ffa48e69043252bf04d6b96, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.714065 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.716335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc2790-4e87-4b16-abbd-8dcd9a4d98a3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.730231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 955/1899] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:28 2022] PUT /identity/v3/projects/0a2609dfd2ab4cfc868134370967eb54/users/def85b0e1ffa48e69043252bf04d6b96/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:28.740520 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f245dc-bd53-4708-9af6-392a9cd9d684 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.740810 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f245dc-bd53-4708-9af6-392a9cd9d684 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.741102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f245dc-bd53-4708-9af6-392a9cd9d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.769986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-83f245dc-bd53-4708-9af6-392a9cd9d684 None None] MFA Rules not processed for user `def85b0e1ffa48e69043252bf04d6b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:28.771358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-83f245dc-bd53-4708-9af6-392a9cd9d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:28.775524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.777099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.786474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 945/1900] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:10:28.840409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 956/1901] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:28.852330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:28.861112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3fb18-4674-4b18-bafd-0a58d7dcbdc8 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:28.911677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a22bf-4fcd-4bb5-91d6-735a97022000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:28.912373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a22bf-4fcd-4bb5-91d6-735a97022000 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:28.912660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a22bf-4fcd-4bb5-91d6-735a97022000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:28.912936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a22bf-4fcd-4bb5-91d6-735a97022000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:28.921860 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a22bf-4fcd-4bb5-91d6-735a97022000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:28.923432 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a22bf-4fcd-4bb5-91d6-735a97022000 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:28.932610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 946/1902] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:38.837071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=60,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:38.928515 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:45.846487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc939ea-61a6-44ed-9a33-0df82e37b6ce None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:45.847549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc939ea-61a6-44ed-9a33-0df82e37b6ce None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:45.848187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc939ea-61a6-44ed-9a33-0df82e37b6ce None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:45.853539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 957/1903] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:10:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:10:45.862300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:45.862801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:45.862801 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:45.881734 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:45.883067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:45.982061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 947/1904] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:10:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:46.026389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc939ea-61a6-44ed-9a33-0df82e37b6ce None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:46.028818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bcc939ea-61a6-44ed-9a33-0df82e37b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:46.047366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc939ea-61a6-44ed-9a33-0df82e37b6ce None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:46.053021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baefdad-33f0-4bbc-bdbd-3eb8a18f5eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:46.053772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baefdad-33f0-4bbc-bdbd-3eb8a18f5eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:46.054054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baefdad-33f0-4bbc-bdbd-3eb8a18f5eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:46.054328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baefdad-33f0-4bbc-bdbd-3eb8a18f5eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:46.066378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baefdad-33f0-4bbc-bdbd-3eb8a18f5eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:46.068167 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baefdad-33f0-4bbc-bdbd-3eb8a18f5eb3 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:46.080686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 958/1905] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:46.752943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:46.842376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbcdb2-7730-4944-8fea-15f673d4172e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:46.847280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:46.848381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:46.848763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:46.849107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] PATH_INFO: `/v3/users/6259dd3a7f0f455aa190d063cdc55efb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:46.850600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6259dd3a7f0f455aa190d063cdc55efb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:46.853450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:46.916107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6259dd3a7f0f455aa190d063cdc55efb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:46.936983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6259dd3a7f0f455aa190d063cdc55efb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:46.945380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6259dd3a7f0f455aa190d063cdc55efb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:46.946242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6259dd3a7f0f455aa190d063cdc55efb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:46.947086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6259dd3a7f0f455aa190d063cdc55efb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:46.964323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 948/1906] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:46 2022] DELETE /identity/v3/users/6259dd3a7f0f455aa190d063cdc55efb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:46.969237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:46.970166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:46.970750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:47.000541 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:47.002473 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:47.118457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 959/1907] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:47.125832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:47.127568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:47.144840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:47.196217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2709d-6c2e-4630-becd-dd1bf72b2b9d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:47.200072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:47.200685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:47.200969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:47.201246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:47.210903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:47.212380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:47.224308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 949/1908] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:47.533772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:47.535356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:47.548184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adefa2-7a66-46ff-aa25-bf48266e752b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:47.553845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:47.554862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:47.555161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:47.555424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] PATH_INFO: `/v3/projects/c4d6e6765d5c4fb4a069cd0239567f1e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:47.556784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d6e6765d5c4fb4a069cd0239567f1e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:47.558781 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:47.613647 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d6e6765d5c4fb4a069cd0239567f1e', 'request_id': 'req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.621702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d6e6765d5c4fb4a069cd0239567f1e', 'request_id': 'req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.628452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d6e6765d5c4fb4a069cd0239567f1e', 'request_id': 'req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.642746 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] The token cache is being invalidate because project c4d6e6765d5c4fb4a069cd0239567f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:47.643031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.643626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.645192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 960/1909] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:47 2022] DELETE /identity/v3/projects/c4d6e6765d5c4fb4a069cd0239567f1e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:47.649234 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:47.659080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add38274-4b6c-4f0b-b4fd-4b650122d1fd service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:47.718642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:47.719448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:47.719732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:47.720039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] PATH_INFO: `/v3/users/ed5428f696fe4c8891de8c83a0ac938f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:47.721247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5428f696fe4c8891de8c83a0ac938f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:47.723220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:47.771392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5428f696fe4c8891de8c83a0ac938f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.783517 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5428f696fe4c8891de8c83a0ac938f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.792305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5428f696fe4c8891de8c83a0ac938f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.793014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5428f696fe4c8891de8c83a0ac938f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.793716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39c767a1-f25a-40e5-9cc0-ea2f1e61813e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5428f696fe4c8891de8c83a0ac938f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:47.806315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 950/1910] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:47 2022] DELETE /identity/v3/users/ed5428f696fe4c8891de8c83a0ac938f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:47.987441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:47.988936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.002447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8f02-1ea2-4db1-af94-1e061a0e7995 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.067168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.068109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.068389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.068666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] PATH_INFO: `/v3/users/59e905d1a67a4551841d24a8d3fca16a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.069968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e905d1a67a4551841d24a8d3fca16a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.071954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.085824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:48.126245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e905d1a67a4551841d24a8d3fca16a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.141348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e905d1a67a4551841d24a8d3fca16a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.153098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e905d1a67a4551841d24a8d3fca16a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.154022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e905d1a67a4551841d24a8d3fca16a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.162884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e905d1a67a4551841d24a8d3fca16a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.169711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 961/1911] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:47 2022] DELETE /identity/v3/users/59e905d1a67a4551841d24a8d3fca16a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:48.175471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.175988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.176458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.199706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:48.201161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.238114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:48.272047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 951/1912] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:48.276444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.281142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.288172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.289561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.295776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5903e-4e96-4ddf-b777-a16418e2e76e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.304622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.305739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.306101 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.306764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] PATH_INFO: `/v3/projects/b2b6b07ad24c40d4b186dbd7347605d2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.309324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b6b07ad24c40d4b186dbd7347605d2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.311697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.379160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b6b07ad24c40d4b186dbd7347605d2', 'request_id': 'req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.393032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b6b07ad24c40d4b186dbd7347605d2', 'request_id': 'req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.402690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b6b07ad24c40d4b186dbd7347605d2', 'request_id': 'req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.421875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17088f-e457-42ef-a58f-166184bd3fd7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.425852 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] The token cache is being invalidate because project b2b6b07ad24c40d4b186dbd7347605d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:48.426154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.427001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e819f1f1-91b1-4df1-bb55-1a3ef46bcf56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:48.433286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 962/1913] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:48 2022] DELETE /identity/v3/projects/b2b6b07ad24c40d4b186dbd7347605d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:48.435055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535553c-57ed-4833-ac38-ed087a432f1a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.435476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535553c-57ed-4833-ac38-ed087a432f1a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.435907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535553c-57ed-4833-ac38-ed087a432f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.458687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d535553c-57ed-4833-ac38-ed087a432f1a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:48.460129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d535553c-57ed-4833-ac38-ed087a432f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.505197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.506578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.507008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.507481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.511791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.535429 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 963/1914] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:48.544624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.545057 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.545814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.570468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:48.571972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.600068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 964/1915] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:48.615313 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.621424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.623407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.623903 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007718-2f82-4d3d-a8bf-26067d75dc92 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.629973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.630739 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.631152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.631751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.632648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:48.633120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.635233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.640080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:48.645952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 952/1916] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:48.692962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 965/1917] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:48.694639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.706882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4131b1-6580-4305-abfb-33c7802dedb9 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.712693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.713945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.714691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.715512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.716560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.718660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.761696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 953/1918] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:48 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:48.762989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.778667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce1490-bf39-450b-a277-0d425948969c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.852654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.854483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.854811 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.855122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.855950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.858399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.883500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 966/1919] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:48 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:48.888176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.903458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df136-3cd3-4577-9f1f-6b682bb80f76 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.909153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.909951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.910284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.910588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.911518 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.913505 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.926950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 954/1920] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:48.931797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.941983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41d80-051b-4dd9-8e4c-cd475a3adb08 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.946588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.947397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.947686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.947989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.948823 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:48.950434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:48.961972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 967/1921] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:48.966058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.977474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3b75-e087-4854-9b0d-4894b53ce60a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:48.984667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:48.984997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330282d-39ed-4ddc-a630-2e6f7978a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:48.985900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330282d-39ed-4ddc-a630-2e6f7978a9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:48.986189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330282d-39ed-4ddc-a630-2e6f7978a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:48.986509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330282d-39ed-4ddc-a630-2e6f7978a9ed admin admin] PATH_INFO: `/v3/projects/22ebdd829004451b8da913151a015ca0/users/0ed0e9196014491c952e25a3d0327335/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:48.987308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:48.989286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:49.002035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9f12-5aba-41f5-9586-c57e8dcb6882 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.006361 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330282d-39ed-4ddc-a630-2e6f7978a9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ebdd829004451b8da913151a015ca0, user_id=0ed0e9196014491c952e25a3d0327335, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.008109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.009130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330282d-39ed-4ddc-a630-2e6f7978a9ed admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.009272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.009581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.009949 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] PATH_INFO: `/v3/projects/92683e5f5f12499db7a223af31ff8a16` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.011570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92683e5f5f12499db7a223af31ff8a16)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.013965 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.025590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 955/1922] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:48 2022] PUT /identity/v3/projects/22ebdd829004451b8da913151a015ca0/users/0ed0e9196014491c952e25a3d0327335/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:49.035790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.036125 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.036552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.063172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] MFA Rules not processed for user `0ed0e9196014491c952e25a3d0327335`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:49.064404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.068161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92683e5f5f12499db7a223af31ff8a16', 'request_id': 'req-0b548504-8d25-475e-87a5-01f3aa6466a2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.076745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92683e5f5f12499db7a223af31ff8a16', 'request_id': 'req-0b548504-8d25-475e-87a5-01f3aa6466a2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.085072 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92683e5f5f12499db7a223af31ff8a16', 'request_id': 'req-0b548504-8d25-475e-87a5-01f3aa6466a2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.098112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] The token cache is being invalidate because project 92683e5f5f12499db7a223af31ff8a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:49.098405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.099001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.100648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 968/1923] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:48 2022] DELETE /identity/v3/projects/92683e5f5f12499db7a223af31ff8a16 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:49.104954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.106292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.134375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 956/1924] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:49.138943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.140667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.168200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:49.175217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b548504-8d25-475e-87a5-01f3aa6466a2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.181359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.182245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.182528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.182824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] PATH_INFO: `/v3/users/d4409c3da6cb41f28fbc7a9bb63887c5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.184047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4409c3da6cb41f28fbc7a9bb63887c5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.186005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.204994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1c0a8-5586-424d-825b-af471a2c49cf None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.212285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.212972 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.213340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.213648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.214380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.216606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.241069 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4409c3da6cb41f28fbc7a9bb63887c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.249371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 957/1925] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:49 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:49.253491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.260485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4409c3da6cb41f28fbc7a9bb63887c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.269308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4409c3da6cb41f28fbc7a9bb63887c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.270191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4409c3da6cb41f28fbc7a9bb63887c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.279371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4409c3da6cb41f28fbc7a9bb63887c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.285795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 969/1926] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:49 2022] DELETE /identity/v3/users/d4409c3da6cb41f28fbc7a9bb63887c5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:49.318997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:49.323257 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd59b1-8b5e-4c35-a576-4d382dac274e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.389422 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.390173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.390512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.390703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.391448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.393664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.414719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 958/1927] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:49 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:49.418783 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.420305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.436472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9133-02de-495a-bb4d-21bd995a8c6e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.442061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.442750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.443166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.443450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.444254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.445899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.461188 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 970/1928] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:49.462442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.472743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa38e-211e-4671-8168-52cc240d3e54 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.477425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.478628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.478904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.479174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] PATH_INFO: `/v3/projects/5c956b963a7048aa8c854af8c2a45f8b/users/19dd7a13eb7749e6bce71c2becb8ae95/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.494773 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c956b963a7048aa8c854af8c2a45f8b, user_id=19dd7a13eb7749e6bce71c2becb8ae95, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.497482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.512241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 959/1929] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:49 2022] PUT /identity/v3/projects/5c956b963a7048aa8c854af8c2a45f8b/users/19dd7a13eb7749e6bce71c2becb8ae95/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:49.516258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.526820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ad87d-9bac-403d-9048-b6cacf7ea468 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.567573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.569455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.590877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.591637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.592028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.592410 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.593218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.594925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.607884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 971/1930] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:49.612514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.635612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb3562-6ef8-4858-95a3-fddaff31c427 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.642885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387d2e-12d7-4c27-94b1-e9fc724b55a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.643799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387d2e-12d7-4c27-94b1-e9fc724b55a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.644109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387d2e-12d7-4c27-94b1-e9fc724b55a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.645797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387d2e-12d7-4c27-94b1-e9fc724b55a7 admin admin] PATH_INFO: `/v3/projects/5c956b963a7048aa8c854af8c2a45f8b/users/19dd7a13eb7749e6bce71c2becb8ae95/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.649425 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd387d2e-12d7-4c27-94b1-e9fc724b55a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c956b963a7048aa8c854af8c2a45f8b, user_id=19dd7a13eb7749e6bce71c2becb8ae95, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.651329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd387d2e-12d7-4c27-94b1-e9fc724b55a7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.664524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 972/1931] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:49 2022] PUT /identity/v3/projects/5c956b963a7048aa8c854af8c2a45f8b/users/19dd7a13eb7749e6bce71c2becb8ae95/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:49.675379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.675797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.676194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.681580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5dc6c-5c1b-4d6d-8fb5-c677f9cc5720 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.712074 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] MFA Rules not processed for user `19dd7a13eb7749e6bce71c2becb8ae95`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:49.713300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.759277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:49.764816 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.766076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.766786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.767139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] PATH_INFO: `/v3/projects/028e1f4cbd814c45bfc44e319e53bb54` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.768728 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=028e1f4cbd814c45bfc44e319e53bb54)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:49.772415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:49.810407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:49.819482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 973/1932] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:49.834284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:49.837250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.860427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028e1f4cbd814c45bfc44e319e53bb54', 'request_id': 'req-80913225-f228-46e0-8ae9-86b4d3781c8f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.868963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028e1f4cbd814c45bfc44e319e53bb54', 'request_id': 'req-80913225-f228-46e0-8ae9-86b4d3781c8f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.876482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028e1f4cbd814c45bfc44e319e53bb54', 'request_id': 'req-80913225-f228-46e0-8ae9-86b4d3781c8f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.888245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] The token cache is being invalidate because project 028e1f4cbd814c45bfc44e319e53bb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:49.888822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.889376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-80913225-f228-46e0-8ae9-86b4d3781c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:49.893677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 960/1933] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:49 2022] DELETE /identity/v3/projects/028e1f4cbd814c45bfc44e319e53bb54 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:10:49.900454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f7397-6ec2-449b-aa84-4de19e34c503 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.900808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f7397-6ec2-449b-aa84-4de19e34c503 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.901154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f7397-6ec2-449b-aa84-4de19e34c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.902322 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ae9f5-b38d-4dab-80e2-8315355cce53 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:49.920889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3a8f7397-6ec2-449b-aa84-4de19e34c503 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:49.922347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3a8f7397-6ec2-449b-aa84-4de19e34c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.962314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:49.962980 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.963258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.963526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:49.965827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:49.990214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 961/1934] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:49.997765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:49.997923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:49.998205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.017018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:50.018139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:50.026374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 962/1935] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:50.030368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.038446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.039284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60a3a3-1f29-4805-8635-dd8897673604 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:50.039960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.046650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:50.047445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.047889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.048241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.049237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:50.049645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.050154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 974/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:50.051654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.064725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 963/1937] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:10:50.069357 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.082486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3590c63-e10c-4dbb-87ee-98f3b69388c7 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:50.088070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:50.091600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.091928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.092185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.092905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.094868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.127157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 975/1938] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:50 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:50.131950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.144693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570c769-6b4d-4e77-9a1d-c3f354c11b37 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:50.209737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:50.210623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.210902 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.211175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.211990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.213970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.241037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 964/1939] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:50 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:50.242405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.252886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b6a6-ca4e-474b-9bd0-eb3d73afe31d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:50.258059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:50.258955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.259238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.259544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.260329 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.262379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.279070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 976/1940] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:50.280401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.292063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce3519-25c8-4199-8655-a474f99f5e56 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:50.297133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341a584-510c-4866-8473-138c2fe8fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:50.298287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341a584-510c-4866-8473-138c2fe8fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.298287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341a584-510c-4866-8473-138c2fe8fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.298483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341a584-510c-4866-8473-138c2fe8fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.299275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341a584-510c-4866-8473-138c2fe8fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.301447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341a584-510c-4866-8473-138c2fe8fe6d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.317313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 965/1941] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:10:50.321787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.329226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:50.338491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc0084-3f15-446b-bc8e-0ab02532e225 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:50.350522 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:50.351689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.352233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.352689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] PATH_INFO: `/v3/projects/c1eb45f5bcd54478ad4b430eaf4830dd/users/eaddc2d825124d48ae17037c340ed6bb/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.415475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb45f5bcd54478ad4b430eaf4830dd, user_id=eaddc2d825124d48ae17037c340ed6bb, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:50.429728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:50.457733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 977/1942] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:50 2022] PUT /identity/v3/projects/c1eb45f5bcd54478ad4b430eaf4830dd/users/eaddc2d825124d48ae17037c340ed6bb/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:50.477566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:50.477923 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:50.478711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:50.511667 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:50.559594 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] MFA Rules not processed for user `eaddc2d825124d48ae17037c340ed6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:50.562127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:50.784287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 966/1943] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:50.797989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:50.800323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:51.010844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d776a0c-ff4e-4e57-92b0-a2ae6cd0f1c6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:51.026514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed600-90d5-4cdc-a1bd-3f9b2906cc5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:51.027207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed600-90d5-4cdc-a1bd-3f9b2906cc5c service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:51.027604 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed600-90d5-4cdc-a1bd-3f9b2906cc5c service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:51.029260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed600-90d5-4cdc-a1bd-3f9b2906cc5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:51.054687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed600-90d5-4cdc-a1bd-3f9b2906cc5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:51.058293 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed600-90d5-4cdc-a1bd-3f9b2906cc5c service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:51.083399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 978/1944] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:51.143471 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:51.145222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:51.228677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fc1e0-d387-410f-9c8a-5629d3863770 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:51.233884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:51.234873 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:51.235251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:51.235577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] PATH_INFO: `/v3/users/0ed0e9196014491c952e25a3d0327335` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:51.237202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed0e9196014491c952e25a3d0327335)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:51.239320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:51.306307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed0e9196014491c952e25a3d0327335'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:51.333155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed0e9196014491c952e25a3d0327335'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:51.346155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed0e9196014491c952e25a3d0327335'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:51.346963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed0e9196014491c952e25a3d0327335'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:51.348207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed0e9196014491c952e25a3d0327335'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:51.373776 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 967/1945] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:51 2022] DELETE /identity/v3/users/0ed0e9196014491c952e25a3d0327335 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:51.375759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:51.376609 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:51.377065 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:51.413406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:51.415076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:51.541047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 979/1946] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:51.550228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:51.551953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:51.581455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:51.659193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2e67-a448-43bd-834d-d19ecbacc486 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:51.663513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:51.664420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:51.664698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:51.664954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:51.674688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:51.676129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:51.688192 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 968/1947] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:10:52.066918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:52.069125 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:52.081778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08a91f-79fe-4060-b804-063b900cba57 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:52.088712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:52.090285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:52.090285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:52.090285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] PATH_INFO: `/v3/projects/22ebdd829004451b8da913151a015ca0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:52.091495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ebdd829004451b8da913151a015ca0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:52.093476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:52.143371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ebdd829004451b8da913151a015ca0', 'request_id': 'req-9bbc11d0-db7d-4af6-8dca-151894b4766d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.149962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ebdd829004451b8da913151a015ca0', 'request_id': 'req-9bbc11d0-db7d-4af6-8dca-151894b4766d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.155834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ebdd829004451b8da913151a015ca0', 'request_id': 'req-9bbc11d0-db7d-4af6-8dca-151894b4766d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.170084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] The token cache is being invalidate because project 22ebdd829004451b8da913151a015ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:52.170374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.171004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.172560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 980/1948] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:52 2022] DELETE /identity/v3/projects/22ebdd829004451b8da913151a015ca0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:52.176588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:52.186752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ac69-78ab-402e-bfe9-aa215dae2053 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:52.268903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:52.270975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:52.271448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:52.271651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] PATH_INFO: `/v3/users/19dd7a13eb7749e6bce71c2becb8ae95` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:52.273043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19dd7a13eb7749e6bce71c2becb8ae95)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:52.274987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:52.330830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19dd7a13eb7749e6bce71c2becb8ae95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.353939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19dd7a13eb7749e6bce71c2becb8ae95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.363442 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19dd7a13eb7749e6bce71c2becb8ae95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.364160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19dd7a13eb7749e6bce71c2becb8ae95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.364774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f030c846-cb3a-46fd-aace-60351346f8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19dd7a13eb7749e6bce71c2becb8ae95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:52.378520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 969/1949] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:10:52 2022] DELETE /identity/v3/users/19dd7a13eb7749e6bce71c2becb8ae95 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:52.997753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:52.999299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:53.019076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc11d0-db7d-4af6-8dca-151894b4766d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.023882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:53.112020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.113475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.113884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.114237 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] PATH_INFO: `/v3/projects/5c956b963a7048aa8c854af8c2a45f8b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.117517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c956b963a7048aa8c854af8c2a45f8b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.120676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.195602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c956b963a7048aa8c854af8c2a45f8b', 'request_id': 'req-7ac29e56-39fe-4104-9995-2b82b07b1f8e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:53.205244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c956b963a7048aa8c854af8c2a45f8b', 'request_id': 'req-7ac29e56-39fe-4104-9995-2b82b07b1f8e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:53.213615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c956b963a7048aa8c854af8c2a45f8b', 'request_id': 'req-7ac29e56-39fe-4104-9995-2b82b07b1f8e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:53.239361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] The token cache is being invalidate because project 5c956b963a7048aa8c854af8c2a45f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:10:53.239933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:53.241052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ac29e56-39fe-4104-9995-2b82b07b1f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:10:53.244253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 981/1950] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:10:52 2022] DELETE /identity/v3/projects/5c956b963a7048aa8c854af8c2a45f8b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:53.249044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.249366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.249549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.276860 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:53.278295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:53.326723 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:53.358493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 970/1951] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:10:53.366794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.367078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.367362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.394036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:53.395639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:53.405086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 982/1952] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:53.409575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.421345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f3501-c35b-46a1-ad92-8ba19344a485 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.426740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.427450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.427691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.427995 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.428804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:10:53.429102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.432380 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.447903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 971/1953] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:10:53.453119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.465278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeb51b-f35f-4843-aee3-b25eaf542b46 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.470152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.470822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.471099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.471510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.472282 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.474146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.510203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 983/1954] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:53.514652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.525531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0052c2-9923-49f0-91df-82dfd6be3ed5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.600201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.601052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.601399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.601739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.602504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.604941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.631919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 972/1955] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:53.633464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.643807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32f53-a16d-435e-b135-2f924dbf7bd6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.648636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.649312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.649592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.649865 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.650628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.652296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.663325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 984/1956] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:53.667903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.678215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009321-0677-4306-a348-b6f7bad748da admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.683178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ec39-2bac-4b46-897f-7bb1feb4dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.684095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ec39-2bac-4b46-897f-7bb1feb4dd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.684378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ec39-2bac-4b46-897f-7bb1feb4dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.684650 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ec39-2bac-4b46-897f-7bb1feb4dd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.685424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ec39-2bac-4b46-897f-7bb1feb4dd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.687127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ec39-2bac-4b46-897f-7bb1feb4dd49 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.698193 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 973/1957] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:53.702498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.713359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6feb07-607c-4840-bb0f-aa2b9e070066 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.719127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.720115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.720397 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.720668 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] PATH_INFO: `/v3/projects/6f36b031fa30490c93e5ea2ae031d96b/users/5470e0fab2274ad49258af7ea8a64ae0/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.737170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f36b031fa30490c93e5ea2ae031d96b, user_id=5470e0fab2274ad49258af7ea8a64ae0, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.739995 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.759109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 985/1958] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:53 2022] PUT /identity/v3/projects/6f36b031fa30490c93e5ea2ae031d96b/users/5470e0fab2274ad49258af7ea8a64ae0/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:53.770393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.770685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.770961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.797509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] MFA Rules not processed for user `5470e0fab2274ad49258af7ea8a64ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:53.798716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:53.863264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 974/1959] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:53.867928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.904381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:53.934818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8a9e-608b-45ff-93c5-83c7b0b64780 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:53.940292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:53.941019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:53.941646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:53.941737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:53.942391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:53.944403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:53.971894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 986/1960] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:10:53.975045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:53.990791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55dabc-7dc8-4081-b9a0-8f05a3ed87cf None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:54.026596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:10:54.057354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:54.058037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.058317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.058592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.059300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:54.061259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:54.080845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 975/1961] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:10:53 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:10:54.085146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:54.095693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379f6e4-32c9-417a-85bf-56ca32e1394d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:54.101017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:54.101678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.101954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.102221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.102947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:54.104936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:54.115773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 987/1962] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:54.120073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:54.130229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8078d-7676-45fc-a81b-a973cad70000 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:54.135347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:54.136287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.136564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.136837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] PATH_INFO: `/v3/projects/4aa854ddab114eee8859be61294a4aed/users/c4b55ffd556844498fc4ac748aada920/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.152198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa854ddab114eee8859be61294a4aed, user_id=c4b55ffd556844498fc4ac748aada920, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:54.154883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:54.168693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 976/1963] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:54 2022] PUT /identity/v3/projects/4aa854ddab114eee8859be61294a4aed/users/c4b55ffd556844498fc4ac748aada920/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:54.172667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:54.182917 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257a85-60c9-4ae5-b5b8-a7a17c47b246 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:54.239725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b5e8-c0c3-437f-8932-1c5c94bec590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:54.240462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b5e8-c0c3-437f-8932-1c5c94bec590 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.240715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b5e8-c0c3-437f-8932-1c5c94bec590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.240991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b5e8-c0c3-437f-8932-1c5c94bec590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.241719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b5e8-c0c3-437f-8932-1c5c94bec590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:54.243346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b5e8-c0c3-437f-8932-1c5c94bec590 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:54.253272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 988/1964] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:10:54.257713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:54.268305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ab48c-d528-45b0-8cb7-438e71773f5c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:54.273273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:54.274169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.274449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.274725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] PATH_INFO: `/v3/projects/4aa854ddab114eee8859be61294a4aed/users/c4b55ffd556844498fc4ac748aada920/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.276807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa854ddab114eee8859be61294a4aed, user_id=c4b55ffd556844498fc4ac748aada920, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:54.279455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:54.290229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 977/1965] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:10:54 2022] PUT /identity/v3/projects/4aa854ddab114eee8859be61294a4aed/users/c4b55ffd556844498fc4ac748aada920/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:10:54.301525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.301789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.302070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.329443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] MFA Rules not processed for user `c4b55ffd556844498fc4ac748aada920`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:10:54.330685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:54.401257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 989/1966] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:10:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:10:54.412412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:10:54.414384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:10:54.472968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1e04-a6e0-4cb5-afa4-13ddd9a8650e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:10:54.477477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:10:54.478448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:10:54.478766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:10:54.479040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:10:54.542249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:10:54.543706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:10:54.552914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 978/1967] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:10:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:04.397728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:04.548758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:06.398347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:06.400008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.413113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dea54-0378-476b-8e3c-e7161d0ec850 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:06.418403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:06.419130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:06.419499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:06.419960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:06.430400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:06.431959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:06.442431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 990/1968] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:06.515072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:06.516885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.589479 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad117db-e0c4-4774-b034-aeb6b1622eb1 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:06.590711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:06.592983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.595088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:06.596201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:06.596630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:06.597156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] PATH_INFO: `/v3/users/def85b0e1ffa48e69043252bf04d6b96` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:06.598876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def85b0e1ffa48e69043252bf04d6b96)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:06.601294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:06.612154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab722-061d-4d96-bfbe-8d98478cd587 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:06.620690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:06.621696 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:06.621986 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:06.622265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] PATH_INFO: `/v3/users/6db4bc77be214d7ea2b8b519b43c18f1` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:06.628826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db4bc77be214d7ea2b8b519b43c18f1)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:06.631170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:06.684713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def85b0e1ffa48e69043252bf04d6b96'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.710667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db4bc77be214d7ea2b8b519b43c18f1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.711216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def85b0e1ffa48e69043252bf04d6b96'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.725750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def85b0e1ffa48e69043252bf04d6b96'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.727117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def85b0e1ffa48e69043252bf04d6b96'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.728557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74471e55-5c02-4171-afca-a2cbd9787467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def85b0e1ffa48e69043252bf04d6b96'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.745880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db4bc77be214d7ea2b8b519b43c18f1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.765394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db4bc77be214d7ea2b8b519b43c18f1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.766573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db4bc77be214d7ea2b8b519b43c18f1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.769259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 979/1969] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:06 2022] DELETE /identity/v3/users/def85b0e1ffa48e69043252bf04d6b96 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:06.774373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:06.775058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:06.775581 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:06.778759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ceb419ae-b43c-4907-8a29-88fc7ed5a825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db4bc77be214d7ea2b8b519b43c18f1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:06.790102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 991/1970] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:06 2022] DELETE /identity/v3/users/6db4bc77be214d7ea2b8b519b43c18f1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:06.796474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:06.796991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:06.797087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:06.805610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:06.807077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.820439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:06.824081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.891884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 980/1971] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:06.900410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:06.901811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.910396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 992/1972] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:06.921493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:06.922945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:06.935879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:06.980483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62953a65-34ea-4dbe-9f1a-750e4ebf6045 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:06.983913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:06.984562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:06.984787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:06.985057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:06.998509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:07.000030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:07.010958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 981/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:07.018911 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d12da-525a-42da-a09e-7eb7452b288e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:07.022567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:07.023223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:07.023500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:07.023770 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:07.034399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:07.036063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:07.048000 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 993/1974] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:07.542526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:07.543975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:07.565656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6ccf1-9c4c-4c33-80dc-9f352fe11154 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:07.572177 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:07.573447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:07.574329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:07.574755 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] PATH_INFO: `/v3/users/a118f82d24624ed1ba4cd0cb046e28e5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:07.576151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a118f82d24624ed1ba4cd0cb046e28e5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:07.578287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:07.631749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:07.634109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:07.644046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:07.658822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198362a4-199c-43c7-8807-aadcb877f9cd service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:07.671311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:07.672447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:07.672732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:07.673020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] PATH_INFO: `/v3/projects/0a2609dfd2ab4cfc868134370967eb54` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:07.674586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2609dfd2ab4cfc868134370967eb54)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:07.676650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:07.689903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a118f82d24624ed1ba4cd0cb046e28e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.702836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a118f82d24624ed1ba4cd0cb046e28e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.711642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a118f82d24624ed1ba4cd0cb046e28e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.712398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a118f82d24624ed1ba4cd0cb046e28e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.713003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a118f82d24624ed1ba4cd0cb046e28e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.734366 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 982/1975] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:07 2022] DELETE /identity/v3/users/a118f82d24624ed1ba4cd0cb046e28e5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:07.736751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:07.739298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:07.760509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2609dfd2ab4cfc868134370967eb54', 'request_id': 'req-7657a27d-f0b5-45b7-b892-f43e90ccb799'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.768175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2609dfd2ab4cfc868134370967eb54', 'request_id': 'req-7657a27d-f0b5-45b7-b892-f43e90ccb799'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.774632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2609dfd2ab4cfc868134370967eb54', 'request_id': 'req-7657a27d-f0b5-45b7-b892-f43e90ccb799'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.794040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] The token cache is being invalidate because project 0a2609dfd2ab4cfc868134370967eb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:07.794424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.795157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7657a27d-f0b5-45b7-b892-f43e90ccb799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.796876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 994/1976] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:07 2022] DELETE /identity/v3/projects/0a2609dfd2ab4cfc868134370967eb54 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:07.798175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c609-3aed-4c7c-8e54-d8222576e849 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:07.798671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c609-3aed-4c7c-8e54-d8222576e849 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:07.799019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c609-3aed-4c7c-8e54-d8222576e849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:07.815771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1464e4-cbd6-46bb-b08d-d8a1a5e311c0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:07.817697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3843c609-3aed-4c7c-8e54-d8222576e849 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:07.818900 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3843c609-3aed-4c7c-8e54-d8222576e849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:07.863822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:07.892807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 995/1977] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:07.894527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:07.895424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:07.896401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:07.896702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] PATH_INFO: `/v3/projects/0762ed7841ad41e9a67eae8f272e3b4c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:07.897492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:07.897855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:07.898001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0762ed7841ad41e9a67eae8f272e3b4c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:07.898354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:07.900316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:07.920755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:07.921991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:07.937453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 996/1978] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:07.937453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:07.937453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:07.971974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0762ed7841ad41e9a67eae8f272e3b4c', 'request_id': 'req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.986498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0762ed7841ad41e9a67eae8f272e3b4c', 'request_id': 'req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:07.995144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0762ed7841ad41e9a67eae8f272e3b4c', 'request_id': 'req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.002666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cd5f-211b-40ec-bfb7-ed9e4c275b82 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.008596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] The token cache is being invalidate because project 0762ed7841ad41e9a67eae8f272e3b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:08.008912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.009705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7f5259d-0f5c-4829-aa32-1b49d4a0429e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.011324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 983/1979] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:07 2022] DELETE /identity/v3/projects/0762ed7841ad41e9a67eae8f272e3b4c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:08.012602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.013050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.013157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.033684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:08.034898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.043488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:08.068893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.069699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.070183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.070512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.072585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.117013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 984/1980] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:08.117013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.117013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.129368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c01670-eb36-42ed-afa7-8d89d435e337 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.134126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.135006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.135284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.135552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] PATH_INFO: `/v3/users/166c1319603f4c30ba138ec3f1d8c146` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.136875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=166c1319603f4c30ba138ec3f1d8c146)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.138932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.147371 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.149037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.158824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 997/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:08.159714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.169933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f6d5d-c9d6-4978-bbae-d7f373928eb3 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.175548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.176264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.176545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.176824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.177565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:08.177876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.179666 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.190903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166c1319603f4c30ba138ec3f1d8c146'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.195306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 998/1982] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:08.196879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.207407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166c1319603f4c30ba138ec3f1d8c146'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.207573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d201ac-1e73-41d3-a69e-34183bcc893d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.212282 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:08.213630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.214294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.214599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.214874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.215676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.217588 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.218404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166c1319603f4c30ba138ec3f1d8c146'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.219697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166c1319603f4c30ba138ec3f1d8c146'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.222113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166c1319603f4c30ba138ec3f1d8c146'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.241591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 985/1983] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:08 2022] DELETE /identity/v3/users/166c1319603f4c30ba138ec3f1d8c146 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:08.252992 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 999/1984] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:08 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:08.257519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.259182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.357534 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947e545-262e-461f-b808-d2d3bd2b72bd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.431836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.432564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.432907 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.433184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.434017 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.439991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.464456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 986/1985] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:08 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:08.466015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.477669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710174b9-f9e7-48b6-bfdb-ed57d8f4b54e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.483159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.484046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.484186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.484450 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.485169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.486822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.501353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1000/1986] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:08.505666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.517252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c27c-6983-42d2-a517-b2a46c2922e3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.528406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.530439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.530727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.531027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.532572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.534855 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.555494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.559253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.566463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 987/1987] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:08.576160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.579645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590ed8-92e6-4742-a5ff-474f4f226658 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.587707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.589028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.589518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.589791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] PATH_INFO: `/v3/projects/98d090f6c37a4a318ae17a2f76f1fba5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.591067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d090f6c37a4a318ae17a2f76f1fba5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.593100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.597068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e861-65dc-400c-b7c8-87f0af372d54 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.602311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.603736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.604046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.604379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] PATH_INFO: `/v3/projects/d4b3a0c457d14f19a7af320462a4af61/users/3711e909bb5f49c799c093b80b287fa9/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.630047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b3a0c457d14f19a7af320462a4af61, user_id=3711e909bb5f49c799c093b80b287fa9, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.633463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.658031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d090f6c37a4a318ae17a2f76f1fba5', 'request_id': 'req-39145099-2557-4d72-991c-6b04a51ccb98'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.664850 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 988/1988] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:08 2022] PUT /identity/v3/projects/d4b3a0c457d14f19a7af320462a4af61/users/3711e909bb5f49c799c093b80b287fa9/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:08.667007 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.667677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d090f6c37a4a318ae17a2f76f1fba5', 'request_id': 'req-39145099-2557-4d72-991c-6b04a51ccb98'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.674630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d090f6c37a4a318ae17a2f76f1fba5', 'request_id': 'req-39145099-2557-4d72-991c-6b04a51ccb98'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.676427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.690416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] The token cache is being invalidate because project 98d090f6c37a4a318ae17a2f76f1fba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:08.691748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.693210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39145099-2557-4d72-991c-6b04a51ccb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.698603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1001/1989] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:08 2022] DELETE /identity/v3/projects/98d090f6c37a4a318ae17a2f76f1fba5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:08.700703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.701220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.701716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.749976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] MFA Rules not processed for user `3711e909bb5f49c799c093b80b287fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:08.752799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.756631 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:08.767043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:08.782031 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90f237-802b-4cff-bcd9-feb0d03721e7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.789372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.790461 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.790877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.791261 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] PATH_INFO: `/v3/projects/113ee3f99ad84238908e7b1b46a9d9eb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.793181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113ee3f99ad84238908e7b1b46a9d9eb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.795214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.851304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1002/1990] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:08.852197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.854261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.864458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113ee3f99ad84238908e7b1b46a9d9eb', 'request_id': 'req-616f6a59-e8cb-45af-baaf-e61e816fc712'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.873955 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a7a3d-2f25-445d-806a-cfe51d8f8b50 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.874882 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113ee3f99ad84238908e7b1b46a9d9eb', 'request_id': 'req-616f6a59-e8cb-45af-baaf-e61e816fc712'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.882029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113ee3f99ad84238908e7b1b46a9d9eb', 'request_id': 'req-616f6a59-e8cb-45af-baaf-e61e816fc712'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.892996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] The token cache is being invalidate because project 113ee3f99ad84238908e7b1b46a9d9eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:08.893278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.893919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:08.895696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 989/1991] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:08 2022] DELETE /identity/v3/projects/113ee3f99ad84238908e7b1b46a9d9eb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:08.896293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:08.897586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:08.944196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.945133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.945416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.945699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] PATH_INFO: `/v3/users/a3473a6de8294396b9c91fd6b12f9186` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.946967 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3473a6de8294396b9c91fd6b12f9186)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:08.949025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:08.959043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f6a59-e8cb-45af-baaf-e61e816fc712 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:08.962720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:08.963368 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:08.963648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:08.963948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:08.965806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.004846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3473a6de8294396b9c91fd6b12f9186'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.016544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3473a6de8294396b9c91fd6b12f9186'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.025183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3473a6de8294396b9c91fd6b12f9186'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.025884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3473a6de8294396b9c91fd6b12f9186'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.028810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.030251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb575995-b6b0-4cf8-9471-14e366e9740d service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.033211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e192a72c-d4cd-4543-b6ff-ec31576e72dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3473a6de8294396b9c91fd6b12f9186'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.039235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1003/1992] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:08 2022] DELETE /identity/v3/users/a3473a6de8294396b9c91fd6b12f9186 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:09.039835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 990/1993] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:09.040777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.041082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.041343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.064643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:09.065991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.105933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:09.149348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1004/1994] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:09.157526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.157821 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.158101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.188938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:09.190623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.210787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 991/1995] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:09.214804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.230964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01986ad-db1d-41e2-b01e-5d6f4fd213a7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.236671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.237790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.238644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.239199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.239654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:09.239996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.241920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.277587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1005/1996] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:09.279142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.290781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cfa94-1ed5-4e46-aa6e-cab389388b7b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.296749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.297644 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.298153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.298661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.299632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.302172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.338003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 992/1997] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:09.341991 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.360336 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a077d5-4420-4339-9fd0-63744a0a7d5c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.392194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.396680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.403099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:09.443045 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.444083 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.444590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.445414 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.448011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.453321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.477934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1006/1998] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:09.482451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.497503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425e274-c491-4739-ae61-484418a988aa admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.497719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441132c-b567-40b4-8d91-1b5af549b196 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.502869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.503040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.503762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.503933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.504130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.504249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.504396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] PATH_INFO: `/v3/projects/78cd540675854b06a4cadc26d810a671` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.504483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.505127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.505719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cd540675854b06a4cadc26d810a671)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.506752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.507615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.518983 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1007/1999] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:09.523005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.534641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd9345-8d27-4471-9721-a66331c61548 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.545934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.545934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.545934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.545934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.546229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.546229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.558251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1008/2000] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:09.562199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.573174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3092bb5-8235-4f05-8b77-04130145637d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.576256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cd540675854b06a4cadc26d810a671', 'request_id': 'req-d1159601-e0a0-42c4-96be-8591db572e94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.588208 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cd540675854b06a4cadc26d810a671', 'request_id': 'req-d1159601-e0a0-42c4-96be-8591db572e94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.606666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cd540675854b06a4cadc26d810a671', 'request_id': 'req-d1159601-e0a0-42c4-96be-8591db572e94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.639760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] The token cache is being invalidate because project 78cd540675854b06a4cadc26d810a671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:09.640111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.646058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d1159601-e0a0-42c4-96be-8591db572e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:09.649289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 993/2001] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:09 2022] DELETE /identity/v3/projects/78cd540675854b06a4cadc26d810a671 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:09.651339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd419e5-9c90-447a-bc35-9acd8e8a715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.652301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd419e5-9c90-447a-bc35-9acd8e8a715e admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.652671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd419e5-9c90-447a-bc35-9acd8e8a715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.652957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd419e5-9c90-447a-bc35-9acd8e8a715e admin admin] PATH_INFO: `/v3/projects/6affb85d19d044a793ea3a2552127e79/users/019481c2bb4d41afa8391898fb41343d/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.654139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4bff0-4b25-4184-a1ae-3ad9741d5891 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.654575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4bff0-4b25-4184-a1ae-3ad9741d5891 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.654874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4bff0-4b25-4184-a1ae-3ad9741d5891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.674594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd419e5-9c90-447a-bc35-9acd8e8a715e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6affb85d19d044a793ea3a2552127e79, user_id=019481c2bb4d41afa8391898fb41343d, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.677351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd419e5-9c90-447a-bc35-9acd8e8a715e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.678178 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e3f4bff0-4b25-4184-a1ae-3ad9741d5891 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:09.679503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e3f4bff0-4b25-4184-a1ae-3ad9741d5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.689258 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 994/2002] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:09.692599 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1009/2003] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:09 2022] PUT /identity/v3/projects/6affb85d19d044a793ea3a2552127e79/users/019481c2bb4d41afa8391898fb41343d/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:09.701676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.701676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.701676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.703156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.703436 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.703707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.716607 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:09.717930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.721976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:09.733210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] MFA Rules not processed for user `019481c2bb4d41afa8391898fb41343d`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:09.734391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.778221 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 995/2004] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:09.782443 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.791509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9c1bb-1866-4102-ad7e-50f2fbb98b40 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.796805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.797563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.797847 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.798128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.798850 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:09.799204 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.800613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1010/2005] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:09.804121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.804989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.806480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:09.818621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 996/2006] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:11:09.823573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.830034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c929a4-39bf-4dd6-a45b-d79af2078e7b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.835039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.835807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.836115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.836430 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.837504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.839278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f28c-145c-470c-88e0-3156dd72a5c1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.839465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.844230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.844890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.845171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.845439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.846126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.850800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:09.863524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:09.873350 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1011/2007] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:09.878858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.886764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 997/2008] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/projects => generated 357 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:09.890879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:09.957581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0ee5-7da3-4bf8-aa1d-7e6badaaac50 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.984701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda0f84-d109-49af-8a8c-1120d249a560 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:09.989303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:09.989976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:09.990256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:09.990531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:09.991222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:09.993214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.027307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 998/2009] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:10.032303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.033001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.033279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.033551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.034258 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.037113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.039268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.052037 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87a7e4-f3f1-4306-a804-49f67ce2e3e6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.057621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.058719 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.059005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.059305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.060139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.061803 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.064108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1012/2010] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:09 2022] POST /identity/v3/users => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:10.067691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.078438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 999/2011] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:10.080102 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.083785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8016897-ac66-41bc-9ccd-09e85f35f610 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.092291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.093109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.093505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.093844 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.094658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.095546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff0391-f394-49e7-a896-34515f5e1ecc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.096667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.101311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.102118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.102484 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.103964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.104950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.106899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.109260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1013/2012] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:10.113303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.119809 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1000/2013] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:10.123195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:10.124617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.124742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fa39c-a9ae-4d02-97b5-2bc01f772c8e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.130169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.131071 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.131386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.131663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] PATH_INFO: `/v3/projects/9337d290f2054c13b43256866e6c2f18/users/5bd18f91ecda4c7e980949e8936a84e4/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.134743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533571-ac38-45e6-ab9a-5a089646cfb6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.140543 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959cbef-5db9-48b8-b7db-3616967a91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.141444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959cbef-5db9-48b8-b7db-3616967a91b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.141718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959cbef-5db9-48b8-b7db-3616967a91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.141984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959cbef-5db9-48b8-b7db-3616967a91b2 admin admin] PATH_INFO: `/v3/projects/7166fadb485a41168ab1bef3c0113a84/users/72f6380e11bb4278a248376b1c74807a/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.147449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9337d290f2054c13b43256866e6c2f18, user_id=5bd18f91ecda4c7e980949e8936a84e4, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.150274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.159490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959cbef-5db9-48b8-b7db-3616967a91b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7166fadb485a41168ab1bef3c0113a84, user_id=72f6380e11bb4278a248376b1c74807a, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.162208 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959cbef-5db9-48b8-b7db-3616967a91b2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.164615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1014/2014] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:10 2022] PUT /identity/v3/projects/9337d290f2054c13b43256866e6c2f18/users/5bd18f91ecda4c7e980949e8936a84e4/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:10.168871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.177107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1001/2015] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:10 2022] PUT /identity/v3/projects/7166fadb485a41168ab1bef3c0113a84/users/72f6380e11bb4278a248376b1c74807a/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:10.188423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.188692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.188968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.217219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] MFA Rules not processed for user `72f6380e11bb4278a248376b1c74807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:10.218451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:10.241442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb495-c0e8-4db3-a1fc-c6d0a85542f4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.287114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1002/2016] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:10.291548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.298675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.299354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.299641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.299945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.300791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.302424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.322121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1015/2017] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:10.322325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:10.323424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.334439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d531c8-7b77-4e9d-b224-6f0c14c58284 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.340801 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782faf76-540c-469f-9c02-cb66b0285731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.341275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782faf76-540c-469f-9c02-cb66b0285731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.341558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782faf76-540c-469f-9c02-cb66b0285731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.341835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782faf76-540c-469f-9c02-cb66b0285731 admin admin] PATH_INFO: `/v3/projects/9337d290f2054c13b43256866e6c2f18/users/5bd18f91ecda4c7e980949e8936a84e4/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.344043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782faf76-540c-469f-9c02-cb66b0285731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9337d290f2054c13b43256866e6c2f18, user_id=5bd18f91ecda4c7e980949e8936a84e4, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.346731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782faf76-540c-469f-9c02-cb66b0285731 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.358845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1016/2018] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:10 2022] PUT /identity/v3/projects/9337d290f2054c13b43256866e6c2f18/users/5bd18f91ecda4c7e980949e8936a84e4/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:10.362495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460391a-b41e-46d3-ac6e-c2288c87fde0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.369596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.369889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.370169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.413073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] MFA Rules not processed for user `5bd18f91ecda4c7e980949e8936a84e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:10.414902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:10.431180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.432146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.432596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.432879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.433587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.435595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.465260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1003/2019] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:10 2022] POST /identity/v3/projects => generated 357 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:10.468961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.489939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:10.505698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1017/2020] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:10.518663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.520216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:10.538238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b391-4455-4fef-bd58-0022bf35db11 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.543744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.544478 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.544761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.545142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.545938 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.551870 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.572301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1004/2021] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:10 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:10.576153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.579432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80516-c5c9-4968-a4f4-1ae7cd38cd38 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.585862 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8603-846d-47d8-8368-678bff1aa94a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.591055 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.591708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.592066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.592342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.593064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.594714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.608468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1005/2022] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:10.609447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.618820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf27dc-baec-4a5a-94f9-e34174c5cdbd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.624058 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.624980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.625611 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.625839 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] PATH_INFO: `/v3/projects/b088e5c6e13e4365ba6544b09635fb4d/users/f906ee1448c44ff488ce938a9c79a197/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.629910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.630598 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.630878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.631259 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.641714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b088e5c6e13e4365ba6544b09635fb4d, user_id=f906ee1448c44ff488ce938a9c79a197, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.645277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.665721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1006/2023] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:10 2022] PUT /identity/v3/projects/b088e5c6e13e4365ba6544b09635fb4d/users/f906ee1448c44ff488ce938a9c79a197/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:10.666731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.680661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:10.708114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.709918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.724421 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1018/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:10.756371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bedf71-9ccc-4587-98c7-18cf93745fd5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.761379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f6363-73b2-48d9-9131-8a1d430bdb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.763229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6363-73b2-48d9-9131-8a1d430bdb59 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.763670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6363-73b2-48d9-9131-8a1d430bdb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.764045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6363-73b2-48d9-9131-8a1d430bdb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.769389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f6363-73b2-48d9-9131-8a1d430bdb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.769389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f6363-73b2-48d9-9131-8a1d430bdb59 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.784011 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1007/2025] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:10.786008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.797957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109450c-38aa-4f72-94e6-9e5e4794e5ae service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.802802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.803660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.803995 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.804267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] PATH_INFO: `/v3/projects/b088e5c6e13e4365ba6544b09635fb4d/users/f906ee1448c44ff488ce938a9c79a197/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.806264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b088e5c6e13e4365ba6544b09635fb4d, user_id=f906ee1448c44ff488ce938a9c79a197, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.808952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:10.821272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1019/2026] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:10 2022] PUT /identity/v3/projects/b088e5c6e13e4365ba6544b09635fb4d/users/f906ee1448c44ff488ce938a9c79a197/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:10.831276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.831570 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.831866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.865682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] MFA Rules not processed for user `f906ee1448c44ff488ce938a9c79a197`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:10.867028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:10.867412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.930046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:10.945206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1008/2027] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:10.953716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee1af5-797d-4279-aeb5-833fe3108e07 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:10.956625 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:10.957941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:10.958861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:10.959807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:10.960172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:10.960504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] PATH_INFO: `/v3/users/019481c2bb4d41afa8391898fb41343d` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:10.961741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019481c2bb4d41afa8391898fb41343d)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:10.963879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.013225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019481c2bb4d41afa8391898fb41343d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.021130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44969-71bc-43da-a902-43eacf9b9560 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.022427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d93a-f0b7-4c96-a261-0aa880121113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.023105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d93a-f0b7-4c96-a261-0aa880121113 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.023386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d93a-f0b7-4c96-a261-0aa880121113 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.023662 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d93a-f0b7-4c96-a261-0aa880121113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.030685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019481c2bb4d41afa8391898fb41343d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.034075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d93a-f0b7-4c96-a261-0aa880121113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.035617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d93a-f0b7-4c96-a261-0aa880121113 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.039808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019481c2bb4d41afa8391898fb41343d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.040849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019481c2bb4d41afa8391898fb41343d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.046749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1009/2028] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:11.050699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019481c2bb4d41afa8391898fb41343d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.056913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1020/2029] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:10 2022] DELETE /identity/v3/users/019481c2bb4d41afa8391898fb41343d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:11.061411 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.061700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.061980 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.082141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:11.083349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.122662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:11.122842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:11.125132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.164150 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1010/2030] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:11.172359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:11.173989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.189744 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1163d-ed8b-47f4-a5b6-44ff85404be4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.194583 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.195416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.195693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.196058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.198068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.245470 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a275-821e-4b8a-a067-7cda2df67ee0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.251827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.252682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.253294 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.253575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.265107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.266544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.267075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.268014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.277360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1021/2031] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:11.280142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1011/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:11.527510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:11.529115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.543578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974724-276a-4505-9c52-4c0e740351eb service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.550239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.551248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.551572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.552075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] PATH_INFO: `/v3/users/5470e0fab2274ad49258af7ea8a64ae0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.553415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5470e0fab2274ad49258af7ea8a64ae0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.555754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.567945 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:11.569546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.572689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:11.586540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc113a-aac3-45a5-af91-e7925a317e54 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.592895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.593913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.595025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.595381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] PATH_INFO: `/v3/projects/6affb85d19d044a793ea3a2552127e79` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.596926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6affb85d19d044a793ea3a2552127e79)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.599142 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.623711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5470e0fab2274ad49258af7ea8a64ae0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.636382 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5470e0fab2274ad49258af7ea8a64ae0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.644060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5470e0fab2274ad49258af7ea8a64ae0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.644670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5470e0fab2274ad49258af7ea8a64ae0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.652467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29078511-89c8-402e-8641-224ca8242910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5470e0fab2274ad49258af7ea8a64ae0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.653643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6affb85d19d044a793ea3a2552127e79', 'request_id': 'req-c6e17761-6189-4af9-a3ae-2b0b02023415'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.658736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1022/2033] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:11 2022] DELETE /identity/v3/users/5470e0fab2274ad49258af7ea8a64ae0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:11.661067 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6affb85d19d044a793ea3a2552127e79', 'request_id': 'req-c6e17761-6189-4af9-a3ae-2b0b02023415'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.663328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.663620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.663923 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.667838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6affb85d19d044a793ea3a2552127e79', 'request_id': 'req-c6e17761-6189-4af9-a3ae-2b0b02023415'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.679262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] The token cache is being invalidate because project 6affb85d19d044a793ea3a2552127e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:11.679476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.680143 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.681271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:11.681724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1012/2034] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:11 2022] DELETE /identity/v3/projects/6affb85d19d044a793ea3a2552127e79 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:11.684640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.685720 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:11.686991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.761731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1023/2035] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:11.767764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e17761-6189-4af9-a3ae-2b0b02023415 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.771265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:11.772556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.772688 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:11.773472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.773753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.774025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] PATH_INFO: `/v3/users/5bd18f91ecda4c7e980949e8936a84e4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.775297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd18f91ecda4c7e980949e8936a84e4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.777271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.779692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:11.848614 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd18f91ecda4c7e980949e8936a84e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.853019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6db6d3-7ca7-467e-ad61-dd3895edcd4a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:11.857306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:11.857977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:11.858262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:11.858590 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:11.861396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd18f91ecda4c7e980949e8936a84e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.869047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:11.869910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd18f91ecda4c7e980949e8936a84e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.870633 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd18f91ecda4c7e980949e8936a84e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.870732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:11.871251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd18f91ecda4c7e980949e8936a84e4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:11.881947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1024/2036] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:11.887689 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1013/2037] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:11 2022] DELETE /identity/v3/users/5bd18f91ecda4c7e980949e8936a84e4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:12.176419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.177881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.179978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.181916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.211347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278b0e-0481-4bfb-9e1e-25a419b2024c service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.254578 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:12.257905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79482420-b82a-41ca-9b07-97e6a08689fa admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.262666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.263684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.264006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.264285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] PATH_INFO: `/v3/projects/9337d290f2054c13b43256866e6c2f18` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.265598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9337d290f2054c13b43256866e6c2f18)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.267537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.281674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.282549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.282837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.283113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] PATH_INFO: `/v3/projects/6f36b031fa30490c93e5ea2ae031d96b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.284328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f36b031fa30490c93e5ea2ae031d96b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.286286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.318332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9337d290f2054c13b43256866e6c2f18', 'request_id': 'req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.327316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9337d290f2054c13b43256866e6c2f18', 'request_id': 'req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.334185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9337d290f2054c13b43256866e6c2f18', 'request_id': 'req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.350556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] The token cache is being invalidate because project 9337d290f2054c13b43256866e6c2f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:12.350904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.351639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2bbc76cd-0d57-487e-bcb2-3eadaba35cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.352643 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f36b031fa30490c93e5ea2ae031d96b', 'request_id': 'req-369fda53-e56b-4f37-99c1-4616b18dd07f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.353670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1014/2038] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:12 2022] DELETE /identity/v3/projects/9337d290f2054c13b43256866e6c2f18 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:12.358735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2f1d-84d0-46b6-bcef-4f03231fc1c3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.359100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2f1d-84d0-46b6-bcef-4f03231fc1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.359383 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2f1d-84d0-46b6-bcef-4f03231fc1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.360777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f36b031fa30490c93e5ea2ae031d96b', 'request_id': 'req-369fda53-e56b-4f37-99c1-4616b18dd07f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.368661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f36b031fa30490c93e5ea2ae031d96b', 'request_id': 'req-369fda53-e56b-4f37-99c1-4616b18dd07f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.382507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e8ab2f1d-84d0-46b6-bcef-4f03231fc1c3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:12.383808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e8ab2f1d-84d0-46b6-bcef-4f03231fc1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.391804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:12.396447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] The token cache is being invalidate because project 6f36b031fa30490c93e5ea2ae031d96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:12.396816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.398046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.402398 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1025/2039] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:12 2022] DELETE /identity/v3/projects/6f36b031fa30490c93e5ea2ae031d96b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:12.403603 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.405354 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.484207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fda53-e56b-4f37-99c1-4616b18dd07f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.495186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1015/2040] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:12.495386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.495386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.495386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.495386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] PATH_INFO: `/v3/users/c4b55ffd556844498fc4ac748aada920` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.495715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b55ffd556844498fc4ac748aada920)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.495715 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.497904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.498300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.498565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.519865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:12.521084 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.534447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1016/2041] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:12.538508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.548172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3943e-f91c-4c4b-b298-d65bafa183cb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.551092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b55ffd556844498fc4ac748aada920'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.552895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.553555 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.553841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.554115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.554872 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:12.555176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.556889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.566949 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b55ffd556844498fc4ac748aada920'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.571901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1017/2042] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:11:12.572548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:12.573833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.579064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b55ffd556844498fc4ac748aada920'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.580654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b55ffd556844498fc4ac748aada920'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.584343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1097e-8ece-4ad3-bf2b-2711f23894cf admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.590105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.591885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.591885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.591885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.592312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.594521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.603732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b55ffd556844498fc4ac748aada920'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:12.610655 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1026/2043] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:12 2022] DELETE /identity/v3/users/c4b55ffd556844498fc4ac748aada920 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:12.633357 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1018/2044] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:12 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:12.638994 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.641209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.715950 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a9bd-95d6-4cab-9f8b-a7056e43d992 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.790869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.791692 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.792069 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.792406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.793219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.795214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.818032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1027/2045] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:12 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:12.819223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.833758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dd22-16f8-4eae-8c4e-0ff113a762ec admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.838700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.839378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.839663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.840101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.840709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.842329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.857743 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1019/2046] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:12.858791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.870062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2045-e2d8-428b-bc11-461dadd5f268 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.875238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.876127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.876580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.877112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.878108 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.879909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.892339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1028/2047] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:12.896646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.919341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf1269-443b-4020-affc-76e45ba3687c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.925129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:12.925319 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ffd14-3bd4-4408-b9f2-22009640844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.926341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ffd14-3bd4-4408-b9f2-22009640844d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.926697 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ffd14-3bd4-4408-b9f2-22009640844d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.926867 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:12.927132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ffd14-3bd4-4408-b9f2-22009640844d admin admin] PATH_INFO: `/v3/projects/521e3449b93e42a6ba4396bb979b674e/users/4d5946c54afd408c86d3a123c7b665ad/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.941677 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e255a-c5b3-4cce-8cfb-4845b2c78f4c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:12.946426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:12.947302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.947576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.947875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] PATH_INFO: `/v3/projects/4aa854ddab114eee8859be61294a4aed` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:12.949094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa854ddab114eee8859be61294a4aed)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.951337 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.954378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ffd14-3bd4-4408-b9f2-22009640844d admin admin] RBAC: Authorizing `identity:create_grant(project_id=521e3449b93e42a6ba4396bb979b674e, user_id=4d5946c54afd408c86d3a123c7b665ad, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:12.957488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ffd14-3bd4-4408-b9f2-22009640844d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:12.972060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1020/2048] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:12 2022] PUT /identity/v3/projects/521e3449b93e42a6ba4396bb979b674e/users/4d5946c54afd408c86d3a123c7b665ad/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:12.982782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:12.983046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:12.983329 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.016154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] MFA Rules not processed for user `4d5946c54afd408c86d3a123c7b665ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:13.017242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.018128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa854ddab114eee8859be61294a4aed', 'request_id': 'req-a45c06f8-c98a-4294-a558-7af866f4311c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.025611 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa854ddab114eee8859be61294a4aed', 'request_id': 'req-a45c06f8-c98a-4294-a558-7af866f4311c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.032472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa854ddab114eee8859be61294a4aed', 'request_id': 'req-a45c06f8-c98a-4294-a558-7af866f4311c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.035887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:13.054714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] The token cache is being invalidate because project 4aa854ddab114eee8859be61294a4aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:13.054998 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.055662 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a45c06f8-c98a-4294-a558-7af866f4311c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.057296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1029/2049] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:12 2022] DELETE /identity/v3/projects/4aa854ddab114eee8859be61294a4aed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:13.063091 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17d3ff-fcfe-417d-a2bd-2ab637fd2836 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.063370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17d3ff-fcfe-417d-a2bd-2ab637fd2836 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.063663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17d3ff-fcfe-417d-a2bd-2ab637fd2836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.080820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2f17d3ff-fcfe-417d-a2bd-2ab637fd2836 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:13.082136 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2f17d3ff-fcfe-417d-a2bd-2ab637fd2836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.089276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1021/2050] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:13.099010 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.100419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.128359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:13.144182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1030/2051] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:13.152465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.152752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.153032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.166856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5076-7b2e-4170-9480-302f7bbb4255 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.170537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.171041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:13.171179 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.171460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.171736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.172336 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.180159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.180300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1031/2052] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:13.181952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.184427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.191228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1022/2053] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:13.193763 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d26ffa-f718-4f7f-bf23-66552eb25a6b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.200910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.201544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.201904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.202093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.202842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:13.203151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.204832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.217210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1032/2054] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:11:13.222640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.222849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.224499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.235599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd265f04-0e89-43bd-a706-dad4dfa9d30c service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.238094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042b13-5f9f-41c6-b595-7797a0aa4161 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.240629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.241310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.241589 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.241920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.242706 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.244982 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.246952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.247959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.248310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.248586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] PATH_INFO: `/v3/users/4d5946c54afd408c86d3a123c7b665ad` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.249832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5946c54afd408c86d3a123c7b665ad)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.251833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.274656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1023/2055] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:13.278799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.309690 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5946c54afd408c86d3a123c7b665ad'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.323552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5946c54afd408c86d3a123c7b665ad'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.333304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5946c54afd408c86d3a123c7b665ad'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.334017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5946c54afd408c86d3a123c7b665ad'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.341957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ff412209-904a-43f2-b43f-d77d284bb562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5946c54afd408c86d3a123c7b665ad'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:13.345467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba57a0-d7a2-47f5-82c6-b249e7569cbc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.348236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1033/2056] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:13 2022] DELETE /identity/v3/users/4d5946c54afd408c86d3a123c7b665ad => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:13.351105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.351222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.351545 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.351826 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.352581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.352687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.352871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.353480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.354822 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.371502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:13.373106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.377609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1024/2057] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:13.381699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.383671 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.399738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36a45d-2ead-4ab7-866e-8485b8a17e21 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.430239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:13.448732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1034/2058] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:13.456277 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.457019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.457419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.457699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.458383 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.458524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.459764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.460042 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.471249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1025/2059] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:13.475205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.485532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989d51-ed8e-475a-8a98-f4c0c1e58bbd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.493775 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.494008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.494308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.494576 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.495918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.498712 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.522617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1026/2060] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:13.522916 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.526562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea38fdc-54c3-420a-b6e2-e51dfe0be1dd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.532567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb241b43-8718-458c-a594-21048eb6686e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.534586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3a49-a932-4cb1-b329-ce6d7e399683 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.534713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241b43-8718-458c-a594-21048eb6686e service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.534713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241b43-8718-458c-a594-21048eb6686e service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.534713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241b43-8718-458c-a594-21048eb6686e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.538852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.539767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.540246 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.542595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] PATH_INFO: `/v3/projects/2c8c05136fc446ffad43df663f14870b/users/70d6d6798e98442d81bd90501a6634db/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.547375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb241b43-8718-458c-a594-21048eb6686e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.548899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb241b43-8718-458c-a594-21048eb6686e service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.561659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8c05136fc446ffad43df663f14870b, user_id=70d6d6798e98442d81bd90501a6634db, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.563440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1035/2061] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:13.564645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.568709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:13.582232 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1027/2062] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:13 2022] PUT /identity/v3/projects/2c8c05136fc446ffad43df663f14870b/users/70d6d6798e98442d81bd90501a6634db/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:13.594914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.595285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.595749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.634826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] MFA Rules not processed for user `70d6d6798e98442d81bd90501a6634db`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:13.636119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:13.717260 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1036/2063] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:13.721339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.799459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0d4d-f01c-4dd0-9612-b45fecd29867 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.806640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.807356 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.807640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.807950 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.808659 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.811298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.849388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1028/2064] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:13.850494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:13.868905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711a17-f6d7-4329-8ea7-faf4667fc371 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:13.948735 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:13.951006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:13.951443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:13.951920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:13.953107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:13.955711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:13.984409 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1037/2065] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:13 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:13.985789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.003115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f71b-9eb6-4d9d-ba0c-bf59c10aa0a1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.013130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.015433 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.017182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.018047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.018763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.018977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.019903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.021654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.030049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65382139-320c-4d92-8d2a-94bbedc6aea2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.036068 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.037064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.037404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.037702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] PATH_INFO: `/v3/projects/521e3449b93e42a6ba4396bb979b674e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.039513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521e3449b93e42a6ba4396bb979b674e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.041294 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.061959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:14.064547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1029/2066] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:14.068559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.093392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefed8e-8745-4d39-b4ab-44b7f389cfae admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.103768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.109651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.110638 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.111457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.113460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.116399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.136551 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1030/2067] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:14.140661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.143344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521e3449b93e42a6ba4396bb979b674e', 'request_id': 'req-f65df08a-02a7-4ba0-9740-b383926bd959'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:14.154016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516e98e-4612-4864-b5a4-f7cf2d5ccf79 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.156165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521e3449b93e42a6ba4396bb979b674e', 'request_id': 'req-f65df08a-02a7-4ba0-9740-b383926bd959'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:14.172042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521e3449b93e42a6ba4396bb979b674e', 'request_id': 'req-f65df08a-02a7-4ba0-9740-b383926bd959'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:14.193063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] The token cache is being invalidate because project 521e3449b93e42a6ba4396bb979b674e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:14.193366 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:14.194359 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f65df08a-02a7-4ba0-9740-b383926bd959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:14.196218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1038/2068] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:14 2022] DELETE /identity/v3/projects/521e3449b93e42a6ba4396bb979b674e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:14.201201 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509476d1-0176-4461-9000-f61c1b2e9bf0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.201487 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509476d1-0176-4461-9000-f61c1b2e9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.201762 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509476d1-0176-4461-9000-f61c1b2e9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.220972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-509476d1-0176-4461-9000-f61c1b2e9bf0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:14.224373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-509476d1-0176-4461-9000-f61c1b2e9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.239745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fbd66-d94f-4ab2-bb9c-c996795e980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.240623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fbd66-d94f-4ab2-bb9c-c996795e980d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.240911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fbd66-d94f-4ab2-bb9c-c996795e980d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.241190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fbd66-d94f-4ab2-bb9c-c996795e980d admin admin] PATH_INFO: `/v3/projects/e03525bc958c4b2cb9122f0830e1248d/users/7b5ed0c36a7742748624c9dcd3839f34/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.256353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fbd66-d94f-4ab2-bb9c-c996795e980d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03525bc958c4b2cb9122f0830e1248d, user_id=7b5ed0c36a7742748624c9dcd3839f34, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.259121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fbd66-d94f-4ab2-bb9c-c996795e980d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.273115 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1031/2069] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:14 2022] PUT /identity/v3/projects/e03525bc958c4b2cb9122f0830e1248d/users/7b5ed0c36a7742748624c9dcd3839f34/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:14.283458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.283827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.284235 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.290596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1039/2070] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:14.298171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.298481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.298758 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.311212 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] MFA Rules not processed for user `7b5ed0c36a7742748624c9dcd3839f34`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:14.312444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.317058 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:14.318236 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.344331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:14.380431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1032/2071] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:14.385128 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.386661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.387714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1040/2072] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:14.391686 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.401041 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e31c4-aa3d-4a3d-b05e-0b697d2c33ad None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.401215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4673b5-1055-42d6-beca-faede1e46ff7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.405790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.405931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.406453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.406627 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.406722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.406903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.407015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.407172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.407785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:14.408148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.410110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.410271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.412794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.423269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1041/2073] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:11:14.427361 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.437947 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5f25-14a1-4a01-88e4-d5ab37e77d64 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.441345 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1033/2074] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:14.445352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.445707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.446488 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.446884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.447327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.448182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.450203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.474424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:14.485219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1042/2075] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:14.489862 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.515110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b4cd6-b40e-4f6b-98d9-66e168afd673 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.575300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0cc98-e79e-47a6-aaad-344939b2d889 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.580474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.581227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.581507 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.581779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.582545 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.584550 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.588857 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.589532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.589811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.590113 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.590835 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.593141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.608785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1043/2076] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:14.609883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.620384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1034/2077] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:14.621457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.624907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2468e-6e1c-47e7-858e-d0e061a40835 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.630349 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.631026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.631342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.631625 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.632385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc782-ec9f-409e-b518-2a631af1b2c4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.632493 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.634358 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.643074 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.643898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.644314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.644676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.645625 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.647513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.647639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1044/2078] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:14.653325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.668134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1035/2079] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:14.669267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.669386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690ccfb-ab07-449e-b648-2b9a09bb7afc admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.675102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.676278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.676633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.677076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.678456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.681453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3fc5-aa2a-4a56-bc5f-df8818e59231 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.681569 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.686964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.688070 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.688321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.688598 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] PATH_INFO: `/v3/projects/4cd23dce250f46f8a6fb38bb0c2b1890/users/a3b961ffe1bb4967b2ec9caf14d6afee/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.693773 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1045/2080] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:14.697974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.704977 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd23dce250f46f8a6fb38bb0c2b1890, user_id=a3b961ffe1bb4967b2ec9caf14d6afee, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.707721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.707953 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4888e-427c-4f78-82a7-503b07f6373f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.713443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dafe69-105c-450d-88d0-bedac7fa2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.714424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dafe69-105c-450d-88d0-bedac7fa2ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.714731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dafe69-105c-450d-88d0-bedac7fa2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.715004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dafe69-105c-450d-88d0-bedac7fa2ef1 admin admin] PATH_INFO: `/v3/projects/dcd55126970b4f3486c67c45c3fc7693/users/d543a093456a40ebbdcd679c329ad4c9/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.721791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1036/2081] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:14 2022] PUT /identity/v3/projects/4cd23dce250f46f8a6fb38bb0c2b1890/users/a3b961ffe1bb4967b2ec9caf14d6afee/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:14.725571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.731179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dafe69-105c-450d-88d0-bedac7fa2ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd55126970b4f3486c67c45c3fc7693, user_id=d543a093456a40ebbdcd679c329ad4c9, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.733985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dafe69-105c-450d-88d0-bedac7fa2ef1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.740829 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:14.750606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1046/2082] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:14 2022] PUT /identity/v3/projects/dcd55126970b4f3486c67c45c3fc7693/users/d543a093456a40ebbdcd679c329ad4c9/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:14.761840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.762148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.762405 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.790116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] MFA Rules not processed for user `d543a093456a40ebbdcd679c329ad4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:14.791363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.805090 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b69e-75db-4e8e-a6f4-fcbe6643c0a0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.863451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1047/2083] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:14.872363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.874056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.889323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.894388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.894388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.894388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.894388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.894388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.907580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1037/2084] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:14.909075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:14.912190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:14.919884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d339f-d748-4903-8684-84e1bb284624 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.925024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280ca5b-c828-48af-8170-edf6cb5f79ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.925990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280ca5b-c828-48af-8170-edf6cb5f79ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.926463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280ca5b-c828-48af-8170-edf6cb5f79ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.926903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280ca5b-c828-48af-8170-edf6cb5f79ad admin admin] PATH_INFO: `/v3/projects/4cd23dce250f46f8a6fb38bb0c2b1890/users/a3b961ffe1bb4967b2ec9caf14d6afee/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.929398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280ca5b-c828-48af-8170-edf6cb5f79ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd23dce250f46f8a6fb38bb0c2b1890, user_id=a3b961ffe1bb4967b2ec9caf14d6afee, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:14.932312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280ca5b-c828-48af-8170-edf6cb5f79ad admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:14.945610 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5b3b3-6cad-44da-85db-889476b080f6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:14.945912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1038/2085] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:14 2022] PUT /identity/v3/projects/4cd23dce250f46f8a6fb38bb0c2b1890/users/a3b961ffe1bb4967b2ec9caf14d6afee/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:14.955903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.957963 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.958245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:14.986596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] MFA Rules not processed for user `a3b961ffe1bb4967b2ec9caf14d6afee`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:14.987802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:14.998524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:14.999154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:14.999440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:14.999716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:15.061725 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1039/2086] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:15.074145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:15.076335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:15.076646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:15.078219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:15.088458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355e27a-6b08-4f7f-9274-38bbf97b5cca None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:15.088608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1048/2087] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:15.092247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:15.092885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:15.093349 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:15.093494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:15.095352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:15.121405 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:15.163308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:15.165048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:15.174240 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1040/2088] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:16.812377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:16.821920 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296047be-39cc-4ded-b6bc-c44c5a7cd33c service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:16.825556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:16.826227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:16.826508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:16.826775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:16.899401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:16.901147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:16.912244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1049/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:17.571808 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:17.580632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e10a-171d-4211-8081-dd19fc968b15 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:17.584727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:17.585493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:17.585867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:17.586201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:17.596038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:17.597457 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:17.607901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1041/2090] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:22.037287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:22.092766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:22.094796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:22.122298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:22.159275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab808-fa9b-4363-b199-569d85fd8e35 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:22.164186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:22.165112 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:22.165396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:22.165999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] PATH_INFO: `/v3/users/70d6d6798e98442d81bd90501a6634db` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:22.167094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d6d6798e98442d81bd90501a6634db)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:22.169211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:22.198314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc261-5a4c-44cc-ae77-b9409c48e7f1 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:22.205666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:22.207135 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:22.207771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:22.208242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] PATH_INFO: `/v3/users/eaddc2d825124d48ae17037c340ed6bb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:22.209500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaddc2d825124d48ae17037c340ed6bb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:22.211926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:22.258846 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d6d6798e98442d81bd90501a6634db'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.276671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d6d6798e98442d81bd90501a6634db'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.289841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaddc2d825124d48ae17037c340ed6bb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.292391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d6d6798e98442d81bd90501a6634db'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.295335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d6d6798e98442d81bd90501a6634db'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.303467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0f6c611c-bfbc-4f69-8c87-92b7b9a5d33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d6d6798e98442d81bd90501a6634db'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.307741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaddc2d825124d48ae17037c340ed6bb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.311812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1050/2091] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:22 2022] DELETE /identity/v3/users/70d6d6798e98442d81bd90501a6634db => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:22.317067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:22.317584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:22.317870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:22.319266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaddc2d825124d48ae17037c340ed6bb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.320228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaddc2d825124d48ae17037c340ed6bb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.321404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-731b3621-ade3-4e7a-a860-5abd86c693ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaddc2d825124d48ae17037c340ed6bb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:22.339582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1042/2092] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:22 2022] DELETE /identity/v3/users/eaddc2d825124d48ae17037c340ed6bb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:22.342527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:22.342527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:22.343810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:22.344132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:22.344415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:22.364635 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:22.365974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:22.416548 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:22.448401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1051/2093] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:22.458376 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:22.460279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:22.504760 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1043/2094] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:22.510912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:22.513317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:22.569941 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557eb44-ff12-4ef7-a316-c7b93213e080 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:22.582261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:22.588913 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:22.589459 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:22.589878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:22.590089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7631-83ea-4e14-826f-9e8727a984e5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:22.600386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:22.600569 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:22.601165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:22.602139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:22.602498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:22.602790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:22.613904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:22.614347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1052/2095] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:22.615783 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:22.627986 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1044/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:23.318514 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:23.320014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:23.346006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21665cd8-c26e-4146-a6b4-8c3d83a44c96 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:23.351562 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:23.358459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.358459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.358459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] PATH_INFO: `/v3/projects/2c8c05136fc446ffad43df663f14870b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.358459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8c05136fc446ffad43df663f14870b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:23.358459 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:23.363219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:23.363219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:23.382145 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:23.400347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60992b7-c7dd-4d3e-a7ea-db7d675cd08f service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:23.412197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:23.413037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.413403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.413586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] PATH_INFO: `/v3/projects/c1eb45f5bcd54478ad4b430eaf4830dd` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.418189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eb45f5bcd54478ad4b430eaf4830dd)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:23.420672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:23.472625 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8c05136fc446ffad43df663f14870b', 'request_id': 'req-b0913036-50e5-4a97-b1c3-2c8cce0bf897'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.484930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8c05136fc446ffad43df663f14870b', 'request_id': 'req-b0913036-50e5-4a97-b1c3-2c8cce0bf897'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.491229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eb45f5bcd54478ad4b430eaf4830dd', 'request_id': 'req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.496919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8c05136fc446ffad43df663f14870b', 'request_id': 'req-b0913036-50e5-4a97-b1c3-2c8cce0bf897'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.497907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eb45f5bcd54478ad4b430eaf4830dd', 'request_id': 'req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.504327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eb45f5bcd54478ad4b430eaf4830dd', 'request_id': 'req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.511575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] The token cache is being invalidate because project 2c8c05136fc446ffad43df663f14870b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:23.511936 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.512740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.516955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1045/2097] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:23 2022] DELETE /identity/v3/projects/2c8c05136fc446ffad43df663f14870b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:23.520764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] The token cache is being invalidate because project c1eb45f5bcd54478ad4b430eaf4830dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:23.521050 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.521170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:23.521709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a2bbfd03-f2de-44a6-9b71-e210e48e60c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.522933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:23.523528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1053/2098] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:23 2022] DELETE /identity/v3/projects/c1eb45f5bcd54478ad4b430eaf4830dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:23.528027 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ef44-33ec-48e4-8653-07da87e31d0f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.528315 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ef44-33ec-48e4-8653-07da87e31d0f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.528591 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ef44-33ec-48e4-8653-07da87e31d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.549680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-de15ef44-33ec-48e4-8653-07da87e31d0f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:23.551107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-de15ef44-33ec-48e4-8653-07da87e31d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:23.600851 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:23.605661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0913036-50e5-4a97-b1c3-2c8cce0bf897 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:23.621742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1054/2099] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:23.630301 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.630605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.630875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.655308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:23.656687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:23.665166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1055/2100] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:23.669869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:23.674132 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:23.675413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.675997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.676285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] PATH_INFO: `/v3/users/7b5ed0c36a7742748624c9dcd3839f34` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.677707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5ed0c36a7742748624c9dcd3839f34)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:23.679737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:23.680183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186cf7e-4a6a-4d35-b82a-77a0fba1e939 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:23.689623 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:23.690446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.690732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.691010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.691785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:23.692151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:23.693930 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:23.707717 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1056/2101] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:11:23.712276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:23.724441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcc3bf-540e-4618-8951-b6ce68fee637 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:23.731330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:23.732640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.732976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.733208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.736532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:23.740006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:23.766253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5ed0c36a7742748624c9dcd3839f34'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.785580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5ed0c36a7742748624c9dcd3839f34'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.798009 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1057/2102] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:23 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:23.799424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5ed0c36a7742748624c9dcd3839f34'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.800378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5ed0c36a7742748624c9dcd3839f34'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.801353 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5ed0c36a7742748624c9dcd3839f34'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:23.804098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:23.806302 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:23.818556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1046/2103] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:23 2022] DELETE /identity/v3/users/7b5ed0c36a7742748624c9dcd3839f34 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:23.884468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:23.912882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a352f7-841c-4afa-89ce-5daeb87d51fd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:23.990403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:23.990403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:23.990403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:23.990403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:23.991024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:23.993076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.020486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1058/2104] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:23 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:24.024546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.037964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262203-d356-4ea0-8631-66df187d3c6d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.043418 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.044284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.044630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.045173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.046063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.049180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.064138 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1047/2105] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:24.068420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.086684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12bb27-7ab7-4662-8a4c-2f866d78e2d6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.097892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4305e1f-eef8-43c7-af72-7238ebaea130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.098839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305e1f-eef8-43c7-af72-7238ebaea130 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.099447 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305e1f-eef8-43c7-af72-7238ebaea130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.099903 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305e1f-eef8-43c7-af72-7238ebaea130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.101079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4305e1f-eef8-43c7-af72-7238ebaea130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.103787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4305e1f-eef8-43c7-af72-7238ebaea130 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.120004 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1059/2106] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:24.124167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.138083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f106-8d4e-4b17-9f1d-87c355c4a3ec admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.146438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.147352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.147628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.147955 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] PATH_INFO: `/v3/projects/497be59fed6f49678fe466c2cc3b07ae/users/5679761995df491396c2bef9441eaa39/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.180213 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497be59fed6f49678fe466c2cc3b07ae, user_id=5679761995df491396c2bef9441eaa39, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.183956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.211069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1048/2107] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:24 2022] PUT /identity/v3/projects/497be59fed6f49678fe466c2cc3b07ae/users/5679761995df491396c2bef9441eaa39/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:24.222596 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.222826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.223077 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.264207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] MFA Rules not processed for user `5679761995df491396c2bef9441eaa39`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:24.266230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:24.371710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1060/2108] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:24.379553 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.388186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.393061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:24.538772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:24.569267 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090bac0-0022-436b-ae09-806a5cc876c1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.574912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.577658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.578195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.578683 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.579621 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.582752 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.604990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20787f3-778d-4312-a9b8-18c43d8acb03 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.627281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.628251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.628534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.628800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] PATH_INFO: `/v3/projects/e03525bc958c4b2cb9122f0830e1248d` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.633341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03525bc958c4b2cb9122f0830e1248d)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.635649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.637945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:24.638201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1049/2109] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:24 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:24.640934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.768827 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03525bc958c4b2cb9122f0830e1248d', 'request_id': 'req-44234018-49e7-47ab-9055-4d1138745d71'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:24.777299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03525bc958c4b2cb9122f0830e1248d', 'request_id': 'req-44234018-49e7-47ab-9055-4d1138745d71'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:24.783580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03525bc958c4b2cb9122f0830e1248d', 'request_id': 'req-44234018-49e7-47ab-9055-4d1138745d71'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:24.786634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0bac6-0431-4af5-b43a-54fc2ee83783 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.811902 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] The token cache is being invalidate because project e03525bc958c4b2cb9122f0830e1248d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:24.812514 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:24.813399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:24.816138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1061/2110] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:24 2022] DELETE /identity/v3/projects/e03525bc958c4b2cb9122f0830e1248d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:24.820924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.827244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:24.901703 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.902716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.903003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.903270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.904323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.907792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.959928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44234018-49e7-47ab-9055-4d1138745d71 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:24.965564 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:24.967977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:24.968179 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1050/2111] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:24 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:24.968679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:24.969228 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] PATH_INFO: `/v3/users/a3b961ffe1bb4967b2ec9caf14d6afee` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:24.971760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b961ffe1bb4967b2ec9caf14d6afee)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:24.972586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:24.974161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:24.975180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:25.023561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59417f-83d6-4a95-8169-b9fdb5fb8341 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:25.029323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:25.031126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.031490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.031858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.032764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:25.035663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:25.054824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1051/2112] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:25.064059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:25.074658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76cddf-1ada-4753-b4ce-88f7531942da admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:25.079871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:25.080151 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b961ffe1bb4967b2ec9caf14d6afee'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.080918 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.081197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.081577 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] PATH_INFO: `/v3/projects/15f324d599b64288baead91908aec6d6/users/1c19f16fd3bf497196d701715ecfc97d/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.096229 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b961ffe1bb4967b2ec9caf14d6afee'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.102130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f324d599b64288baead91908aec6d6, user_id=1c19f16fd3bf497196d701715ecfc97d, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:25.106111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:25.108848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b961ffe1bb4967b2ec9caf14d6afee'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.109683 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b961ffe1bb4967b2ec9caf14d6afee'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.121674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b961ffe1bb4967b2ec9caf14d6afee'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.132448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1062/2113] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:24 2022] DELETE /identity/v3/users/a3b961ffe1bb4967b2ec9caf14d6afee => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:25.135364 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1052/2114] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:25 2022] PUT /identity/v3/projects/15f324d599b64288baead91908aec6d6/users/1c19f16fd3bf497196d701715ecfc97d/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:25.139426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:25.140896 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:25.152659 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:25.225154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7008-8ec9-4d8f-b375-d9ce21a0b6b7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:25.231369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c33f20-4dd7-4fed-9844-bb03fb264cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:25.232335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33f20-4dd7-4fed-9844-bb03fb264cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.232455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33f20-4dd7-4fed-9844-bb03fb264cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.232918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33f20-4dd7-4fed-9844-bb03fb264cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.233553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c33f20-4dd7-4fed-9844-bb03fb264cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:25.235231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c33f20-4dd7-4fed-9844-bb03fb264cfb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:25.247454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1063/2115] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:25.251815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:25.312615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:25.340591 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cfea5-c57a-4309-97fe-58816075f69b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:25.345750 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:25.346757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.347141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.347516 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] PATH_INFO: `/v3/projects/15f324d599b64288baead91908aec6d6/users/1c19f16fd3bf497196d701715ecfc97d/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.349993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f324d599b64288baead91908aec6d6, user_id=1c19f16fd3bf497196d701715ecfc97d, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:25.353958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:25.375991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1053/2116] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:25 2022] PUT /identity/v3/projects/15f324d599b64288baead91908aec6d6/users/1c19f16fd3bf497196d701715ecfc97d/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:25.388996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.389496 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.389573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.425512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] MFA Rules not processed for user `1c19f16fd3bf497196d701715ecfc97d`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:25.426657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:25.524711 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1064/2117] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:25.538247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:25.540359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:25.627915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485454-3061-4de4-8088-32f2fcdfe0a2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:25.637572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:25.638301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.639228 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.639586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.642118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:25.662064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:25.663909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:25.759890 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:25.761454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43a082-d4c4-4aba-ab23-2f30dcf16267 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:25.788572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1054/2118] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:25.842553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a68dd-d8cb-41cf-85a5-aa7a72562399 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:25.854389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:25.857978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:25.858665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:25.858948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] PATH_INFO: `/v3/projects/4cd23dce250f46f8a6fb38bb0c2b1890` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:25.862780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd23dce250f46f8a6fb38bb0c2b1890)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:25.866694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:25.939394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:25.969477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd23dce250f46f8a6fb38bb0c2b1890', 'request_id': 'req-33580297-a0f6-4cd4-a3d9-0db9945572f8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.981381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd23dce250f46f8a6fb38bb0c2b1890', 'request_id': 'req-33580297-a0f6-4cd4-a3d9-0db9945572f8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:25.992741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd23dce250f46f8a6fb38bb0c2b1890', 'request_id': 'req-33580297-a0f6-4cd4-a3d9-0db9945572f8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.017940 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] The token cache is being invalidate because project 4cd23dce250f46f8a6fb38bb0c2b1890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:26.018235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.018974 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-33580297-a0f6-4cd4-a3d9-0db9945572f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.023059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1065/2119] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:25 2022] DELETE /identity/v3/projects/4cd23dce250f46f8a6fb38bb0c2b1890 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:26.028086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.028540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.028961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.057973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:26.060960 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.229531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.229833 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.230172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.245438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1055/2120] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:26.267338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:26.269434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.280038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1066/2121] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:26.284110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.304971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b2dc-bf8c-4586-8dec-41bf759c729a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.306576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.308796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.328946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.329630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.329904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.330203 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.334552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:26.334924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.337463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.369036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b060b-6f6a-4b26-a684-1a834e675b71 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.385191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.386130 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.386382 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.386660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] PATH_INFO: `/v3/users/d543a093456a40ebbdcd679c329ad4c9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.391901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1056/2122] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:26.395254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d543a093456a40ebbdcd679c329ad4c9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.396140 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.399468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.436052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066e552-5314-4a09-a228-2cbb336ae297 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.447301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.450078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.450078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.450078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.450078 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.451692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.465073 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:26.489472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd543a093456a40ebbdcd679c329ad4c9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.510132 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd543a093456a40ebbdcd679c329ad4c9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.517714 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1057/2123] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:26 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:26.521967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.527499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd543a093456a40ebbdcd679c329ad4c9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.528385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd543a093456a40ebbdcd679c329ad4c9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.541392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1a2ad3bb-fd9d-455b-84da-be8966ecf88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd543a093456a40ebbdcd679c329ad4c9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.549939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1067/2124] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:26 2022] DELETE /identity/v3/users/d543a093456a40ebbdcd679c329ad4c9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:26.554566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.556195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.556704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.585887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:26.587328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.626595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97091ea-6aa4-45ef-b7e4-3257f807d557 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.703238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1068/2125] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:26.713148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.714732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.734859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.735948 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.736412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.736903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.737758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.740925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.752106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:26.774700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1058/2126] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:26 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:26.778874 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.782289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.797721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8aa05-0ee7-4d6e-a8eb-f5c04f795c8d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.803701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.804537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.805009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.805260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.806268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.808099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.821375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c525e3c-4879-48dc-95f5-82f30546f87b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.826633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.827584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.828041 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.828574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.835654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1059/2127] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:26.836425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.843382 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:26.843664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.845316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.857632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1069/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:26.858808 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.860881 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce306f-e5c6-4bef-b9ed-af1ee3cbf8e0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.867386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.868389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.868674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.869014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] PATH_INFO: `/v3/users/d2c0e3c91a54496089c96c8dd2a13258` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.870477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c0e3c91a54496089c96c8dd2a13258)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.872789 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ed74a-ddec-4bf4-aa22-f0496ffe82f4 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.873318 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.880935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.881864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.882287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.883396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.884878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.886848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.903368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1070/2129] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:26.904656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:26.928817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f36a98-0fff-4f01-895b-71fceda2e48e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:26.937839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2f59-5521-4f5d-b205-658ad930cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:26.938914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2f59-5521-4f5d-b205-658ad930cb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:26.939725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2f59-5521-4f5d-b205-658ad930cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:26.939725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2f59-5521-4f5d-b205-658ad930cb70 admin admin] PATH_INFO: `/v3/projects/035e2cc7025240a899a22bb9748ae7fc/users/982d09ee8179469d863fe83ca1c6fe72/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:26.965350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c0e3c91a54496089c96c8dd2a13258'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.970063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae2f59-5521-4f5d-b205-658ad930cb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035e2cc7025240a899a22bb9748ae7fc, user_id=982d09ee8179469d863fe83ca1c6fe72, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:26.973441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae2f59-5521-4f5d-b205-658ad930cb70 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:26.986753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c0e3c91a54496089c96c8dd2a13258'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:26.992231 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:26.998906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1071/2130] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:26 2022] PUT /identity/v3/projects/035e2cc7025240a899a22bb9748ae7fc/users/982d09ee8179469d863fe83ca1c6fe72/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:27.001434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c0e3c91a54496089c96c8dd2a13258'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.001733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.002063 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.002423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.003062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c0e3c91a54496089c96c8dd2a13258'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.004656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c0e3c91a54496089c96c8dd2a13258'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.024497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1060/2131] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:26 2022] DELETE /identity/v3/users/d2c0e3c91a54496089c96c8dd2a13258 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:27.026753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:27.028049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.150873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1072/2132] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:27.164762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.166647 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.237105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a479c9-3718-4ccf-aad5-214de6a24e98 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.241091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.242375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.242656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.242969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.255086 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.257381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.268691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1061/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:27.277856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.279629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.310415 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012194a5-1b73-465a-91fc-5e19a0391d9e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.316707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.317751 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.318094 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.318430 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] PATH_INFO: `/v3/projects/edf2d3ac8a4646048f5235e7017ff841` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.320706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf2d3ac8a4646048f5235e7017ff841)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.323093 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.329036 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.331285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.346390 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e7a6-eb85-4e0a-ad50-94dccac9470a service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.352919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.355157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.355373 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.355756 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] PATH_INFO: `/v3/projects/dcd55126970b4f3486c67c45c3fc7693` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.357730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd55126970b4f3486c67c45c3fc7693)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.360218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.418706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf2d3ac8a4646048f5235e7017ff841', 'request_id': 'req-ebfe4c23-99b3-462e-978b-2d8330a1b38d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.426637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf2d3ac8a4646048f5235e7017ff841', 'request_id': 'req-ebfe4c23-99b3-462e-978b-2d8330a1b38d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.435379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf2d3ac8a4646048f5235e7017ff841', 'request_id': 'req-ebfe4c23-99b3-462e-978b-2d8330a1b38d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.475363 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] The token cache is being invalidate because project edf2d3ac8a4646048f5235e7017ff841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:27.475651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.477328 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ebfe4c23-99b3-462e-978b-2d8330a1b38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.480118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1073/2134] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:27 2022] DELETE /identity/v3/projects/edf2d3ac8a4646048f5235e7017ff841 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:27.485887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb54b9-92bf-4192-b277-55f50d9a8536 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.486162 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb54b9-92bf-4192-b277-55f50d9a8536 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.486401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb54b9-92bf-4192-b277-55f50d9a8536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.487426 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd55126970b4f3486c67c45c3fc7693', 'request_id': 'req-7de0a224-68f7-4ac1-a0b1-4168e02432c6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.507967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd55126970b4f3486c67c45c3fc7693', 'request_id': 'req-7de0a224-68f7-4ac1-a0b1-4168e02432c6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.532160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd55126970b4f3486c67c45c3fc7693', 'request_id': 'req-7de0a224-68f7-4ac1-a0b1-4168e02432c6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.543380 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-40fb54b9-92bf-4192-b277-55f50d9a8536 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:27.544725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-40fb54b9-92bf-4192-b277-55f50d9a8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.561744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] The token cache is being invalidate because project dcd55126970b4f3486c67c45c3fc7693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:27.562029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.563532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7de0a224-68f7-4ac1-a0b1-4168e02432c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.567640 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1062/2135] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:27 2022] DELETE /identity/v3/projects/dcd55126970b4f3486c67c45c3fc7693 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:27.572681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.572969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.574303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.579521 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:27.610371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:27.614322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.685680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1074/2136] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:27.693051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9a333-2028-4d06-80bf-d4093cec0af3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.693249 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9a333-2028-4d06-80bf-d4093cec0af3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.693443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9a333-2028-4d06-80bf-d4093cec0af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.724857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f6d9a333-2028-4d06-80bf-d4093cec0af3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:27.731275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f6d9a333-2028-4d06-80bf-d4093cec0af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.749003 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1075/2137] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:27.749343 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1063/2138] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:27.749772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.749772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.749772 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.752137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.768029 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f687c50-4a90-44e0-8494-8052f925b673 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.781023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.787324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.787709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.789584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.791472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:27.791792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.796419 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.797389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:27.798841 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.813341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1076/2139] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:27.814594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.817577 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.819508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:27.831167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1064/2140] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:27.832920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.845375 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbbb2-e35d-4902-9912-97f9a37064f7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.851663 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.853019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.853831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.854312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] PATH_INFO: `/v3/users/72f6380e11bb4278a248376b1c74807a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.855839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f6380e11bb4278a248376b1c74807a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.858137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.869934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7b55-d9eb-4692-ad75-b12b623a800a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.881726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.882410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.882692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.882968 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.883777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:27.884145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.885768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.911684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1065/2141] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:27.912480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.935080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f6380e11bb4278a248376b1c74807a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.936523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a169c-4a6a-4c5f-b2f1-85882edba7eb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:27.942326 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c0ab-d1cf-449a-9cf9-b32965ddf6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:27.942993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c0ab-d1cf-449a-9cf9-b32965ddf6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.943275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c0ab-d1cf-449a-9cf9-b32965ddf6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.943547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c0ab-d1cf-449a-9cf9-b32965ddf6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:27.944275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c0ab-d1cf-449a-9cf9-b32965ddf6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:27.946268 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c0ab-d1cf-449a-9cf9-b32965ddf6aa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:27.948672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f6380e11bb4278a248376b1c74807a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.960355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f6380e11bb4278a248376b1c74807a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.961035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f6380e11bb4278a248376b1c74807a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.968737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f6380e11bb4278a248376b1c74807a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:27.978946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1077/2142] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:27 2022] DELETE /identity/v3/users/72f6380e11bb4278a248376b1c74807a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:27.978946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:27.978946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:27.981173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1066/2143] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:27.982500 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:27.982789 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:27.983064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.000504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:28.001555 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.056738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc324e-30cd-49f8-9ae9-2b04738ebba0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.081849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1067/2144] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:28.081849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.083260 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.084339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:28.104013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb26329-8920-4b32-acc7-595b0a76837a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.109019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.109804 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.110009 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.110286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.111051 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.113327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.132855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.133601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.133888 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.134165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.135011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.137129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.141533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1068/2145] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:28 2022] POST /identity/v3/users => generated 295 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:28.141533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.143610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.192443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1078/2146] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:27 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:28.193473 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.216764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ecfe7-f9ec-467c-9f1f-5c1364b365e8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.273226 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f2c20-86be-4cd4-a24c-74239bfad209 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.279100 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aebf5-815c-4d0d-ae5e-f2fa30963703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.279805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aebf5-815c-4d0d-ae5e-f2fa30963703 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.280163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aebf5-815c-4d0d-ae5e-f2fa30963703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.280386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aebf5-815c-4d0d-ae5e-f2fa30963703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.281148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462aebf5-815c-4d0d-ae5e-f2fa30963703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.282028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.282774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.282926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462aebf5-815c-4d0d-ae5e-f2fa30963703 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.283171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.283524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.294539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.294724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1079/2147] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:28.296103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.296394 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.296509 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.296704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.307495 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1069/2148] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:28.308371 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.319259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226772b-695d-42ca-a21b-99092c3b6c7c service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.324490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.325179 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.325600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.325716 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] MFA Rules not processed for user `982d09ee8179469d863fe83ca1c6fe72`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:28.325895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.326586 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.326926 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.328858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.336354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:28.355556 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1070/2149] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:28 2022] POST /identity/v3/users => generated 291 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:28.356685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.374824 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bde616-c1e4-4215-b9b5-b2ff80d0d6f1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.387100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.387935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.388264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.388920 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.389729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.393735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.413082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1071/2150] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:28.413082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.424954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edab4b-58d8-42a7-8028-5173b98c6a48 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.432887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.435737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.436005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.436666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.437186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.439729 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.442139 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1080/2151] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:28.443698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.456090 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d608c2-6e60-468a-91e1-4b1863dbb72d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.456286 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1072/2152] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:28.456797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.460993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.463670 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.465332 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.465719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.466636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] PATH_INFO: `/v3/projects/07fb70eed59e461d9ab1c033409f85f2/users/3d3b0e71ebb447c1877183c931812ab8/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.489873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fb70eed59e461d9ab1c033409f85f2, user_id=3d3b0e71ebb447c1877183c931812ab8, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.493441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.513123 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1081/2153] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:28 2022] PUT /identity/v3/projects/07fb70eed59e461d9ab1c033409f85f2/users/3d3b0e71ebb447c1877183c931812ab8/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:28.514114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.541031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:28.558211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830925d-6cbe-4d77-b60f-dffae6bc82ca admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.617016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.617681 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.618003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.618278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.619750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6b5e2-38fa-4d1a-95b5-d5dc533e2a7c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.625018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a775c-62bc-4f48-9614-12bc628390b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.625891 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a775c-62bc-4f48-9614-12bc628390b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.626319 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a775c-62bc-4f48-9614-12bc628390b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.626742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a775c-62bc-4f48-9614-12bc628390b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.627624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a775c-62bc-4f48-9614-12bc628390b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.629439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a775c-62bc-4f48-9614-12bc628390b2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.644347 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1082/2154] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:28.646105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.646404 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.646700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.670632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:28.671859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.684024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1083/2155] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:28.684264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.685284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.685833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.696761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63b587-a2b6-4146-b20e-77fab8b21144 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.697173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1073/2156] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:28.697867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.699202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.703192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.704286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.705169 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.705517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] PATH_INFO: `/v3/projects/f5eb37d6036947d080d51dd644fbd766/users/a39ac3a839ba470181b0466580fb5065/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.714547 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc86f38-d7fa-49ca-a547-5fa39778216d service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.721675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.722550 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.722827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.723097 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] PATH_INFO: `/v3/projects/7166fadb485a41168ab1bef3c0113a84` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.724216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5eb37d6036947d080d51dd644fbd766, user_id=a39ac3a839ba470181b0466580fb5065, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.724334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7166fadb485a41168ab1bef3c0113a84)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.726220 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.727566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.745975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1084/2157] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:28 2022] PUT /identity/v3/projects/f5eb37d6036947d080d51dd644fbd766/users/a39ac3a839ba470181b0466580fb5065/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:28.748102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.751621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.767833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=3,keystone:SELECT=95,keystone:DELETE=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:28.782786 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7166fadb485a41168ab1bef3c0113a84', 'request_id': 'req-585070f7-d6b2-47a9-bff0-3fff2b4b953e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:28.791169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7166fadb485a41168ab1bef3c0113a84', 'request_id': 'req-585070f7-d6b2-47a9-bff0-3fff2b4b953e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:28.800211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7166fadb485a41168ab1bef3c0113a84', 'request_id': 'req-585070f7-d6b2-47a9-bff0-3fff2b4b953e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:28.812180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] The token cache is being invalidate because project 7166fadb485a41168ab1bef3c0113a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:28.812691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:28.813737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-585070f7-d6b2-47a9-bff0-3fff2b4b953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:28.815531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1074/2158] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:28 2022] DELETE /identity/v3/projects/7166fadb485a41168ab1bef3c0113a84 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:28.820134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.820492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.820794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.826248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f526-64d9-41d3-a486-22bcd54001d8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.841291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:28.842645 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.905908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.906567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.906849 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.907195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.909081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.912899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1075/2159] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:28.914149 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.915449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.924631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.927172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.928423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a948b-4e12-4ea7-a7fc-8d9e2538c1b4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.942956 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1085/2160] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:28.943868 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:28.944787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.945402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:28.957167 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.957541 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.957928 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] PATH_INFO: `/v3/users/f906ee1448c44ff488ce938a9c79a197` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.962434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f906ee1448c44ff488ce938a9c79a197)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.964615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:28.966134 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f1337-a93c-4cf0-9933-6e49cf7617ca service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:28.977223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:28.979504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:28.979958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:28.980458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] PATH_INFO: `/v3/users/5679761995df491396c2bef9441eaa39` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:28.983936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5679761995df491396c2bef9441eaa39)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:28.986449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.056477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:29.081276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f906ee1448c44ff488ce938a9c79a197'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.081420 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5679761995df491396c2bef9441eaa39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.094121 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5679761995df491396c2bef9441eaa39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.097322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f906ee1448c44ff488ce938a9c79a197'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.104897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5679761995df491396c2bef9441eaa39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.105879 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5679761995df491396c2bef9441eaa39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.109840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f906ee1448c44ff488ce938a9c79a197'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.110820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f906ee1448c44ff488ce938a9c79a197'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.112169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5709cec6-464e-4801-85d6-95943c486d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f906ee1448c44ff488ce938a9c79a197'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.114506 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5679761995df491396c2bef9441eaa39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.126011 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1086/2161] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:28 2022] DELETE /identity/v3/users/5679761995df491396c2bef9441eaa39 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:29.128997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:29.129729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.132630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1076/2162] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:28 2022] DELETE /identity/v3/users/f906ee1448c44ff488ce938a9c79a197 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:29.134528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.134672 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.134944 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.154898 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:29.156275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.200759 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:29.220890 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851501-94c6-4c38-9244-dcff951ff471 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:29.250392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1077/2163] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:29.270044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:29.271763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.313693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:29.314893 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.315423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.315957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.320186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.364224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:29.367070 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.390457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1087/2164] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:29.404127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7440530-a10f-4772-988f-2aaf52d839a0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:29.408710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0618-abf6-4f61-875b-3508a0e016d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:29.409597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0618-abf6-4f61-875b-3508a0e016d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.409958 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0618-abf6-4f61-875b-3508a0e016d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.410303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0618-abf6-4f61-875b-3508a0e016d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.425137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b0618-abf6-4f61-875b-3508a0e016d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:29.426947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b0618-abf6-4f61-875b-3508a0e016d2 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.441739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1078/2165] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:29.510253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:29.511782 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.533639 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f92d35-336e-4033-bc37-ff3858ceae93 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:29.539654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:29.540713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.540946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.541215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] PATH_INFO: `/v3/projects/b088e5c6e13e4365ba6544b09635fb4d` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.542962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b088e5c6e13e4365ba6544b09635fb4d)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:29.545766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.604601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b088e5c6e13e4365ba6544b09635fb4d', 'request_id': 'req-de2c5c36-b85b-47e3-8dc0-e08f5f727041'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.611745 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b088e5c6e13e4365ba6544b09635fb4d', 'request_id': 'req-de2c5c36-b85b-47e3-8dc0-e08f5f727041'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.616722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:29.618534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b088e5c6e13e4365ba6544b09635fb4d', 'request_id': 'req-de2c5c36-b85b-47e3-8dc0-e08f5f727041'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.634790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] The token cache is being invalidate because project b088e5c6e13e4365ba6544b09635fb4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:29.635085 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.635725 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de2c5c36-b85b-47e3-8dc0-e08f5f727041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:29.637502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1088/2166] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:29 2022] DELETE /identity/v3/projects/b088e5c6e13e4365ba6544b09635fb4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:29.642596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.642964 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.643200 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.663210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:29.664438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.726506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1079/2167] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:29.735797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.736117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.736428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.756646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:29.757795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:29.765855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1089/2168] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:29.770182 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:29.780780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5ea08-b200-4eeb-8c63-c7c7cd8db28e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:29.785779 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:29.786450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.786731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.787003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.787739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:29.788076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:29.789765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.801917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1080/2169] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:29.806457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:29.816709 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223311-1660-42bf-bf7e-3dd0fe4f4965 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:29.821861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:29.822528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.822805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.823075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.823785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:29.825732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.856205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1090/2170] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:29 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:29.860416 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:29.871700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95617161-1d01-4975-a8e7-f60d68a4914d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:29.945334 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:29.946924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:29.947665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:29.948091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:29.949129 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:29.951374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:29.961860 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:29.981571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1081/2171] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:29 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:29.983296 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.000232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723682b-be3d-4408-91f2-76b817de6bc3 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.032373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.036232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.037549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.038502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.041400 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.044408 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.064645 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1091/2172] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:30.065567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.076458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326f00-257e-4134-9b9a-033ff7ba364c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.083466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.084171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.084447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.084727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.085566 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.087304 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.107295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.109883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:30.128575 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1082/2173] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:30.132034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682452-64b8-4756-81da-9c58ee235657 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.133632 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.150854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.153005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.153502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.154589 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] PATH_INFO: `/v3/projects/497be59fed6f49678fe466c2cc3b07ae` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.156286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=497be59fed6f49678fe466c2cc3b07ae)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.159186 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.159623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e966a-bcce-46ca-9e84-95ee6c935ee0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.176216 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9af97-ef54-46a1-b742-8b0b16ca1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.177185 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9af97-ef54-46a1-b742-8b0b16ca1e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.177463 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9af97-ef54-46a1-b742-8b0b16ca1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.177740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9af97-ef54-46a1-b742-8b0b16ca1e85 admin admin] PATH_INFO: `/v3/projects/eb4e4799ddfe4686b3fe393cf967eff9/users/8a5d449fcaca49df891511e0de184c3c/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.200861 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9af97-ef54-46a1-b742-8b0b16ca1e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4e4799ddfe4686b3fe393cf967eff9, user_id=8a5d449fcaca49df891511e0de184c3c, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.203972 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9af97-ef54-46a1-b742-8b0b16ca1e85 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.220751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1083/2174] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:30 2022] PUT /identity/v3/projects/eb4e4799ddfe4686b3fe393cf967eff9/users/8a5d449fcaca49df891511e0de184c3c/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:30.229277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497be59fed6f49678fe466c2cc3b07ae', 'request_id': 'req-dce1cbe0-79e1-474b-908e-ce933377e0cd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.235158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.235496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.235934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.241703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497be59fed6f49678fe466c2cc3b07ae', 'request_id': 'req-dce1cbe0-79e1-474b-908e-ce933377e0cd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.260914 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497be59fed6f49678fe466c2cc3b07ae', 'request_id': 'req-dce1cbe0-79e1-474b-908e-ce933377e0cd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.267044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] MFA Rules not processed for user `982d09ee8179469d863fe83ca1c6fe72`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:30.268733 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:30.305814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] The token cache is being invalidate because project 497be59fed6f49678fe466c2cc3b07ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:30.306253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.307750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dce1cbe0-79e1-474b-908e-ce933377e0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.310755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1092/2175] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:30 2022] DELETE /identity/v3/projects/497be59fed6f49678fe466c2cc3b07ae => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:30.312351 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.312726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.313213 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.355895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1084/2176] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:30.355895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.355895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:30.375584 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] MFA Rules not processed for user `8a5d449fcaca49df891511e0de184c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:30.377033 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:30.472189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1093/2177] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:30.476861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.479120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:30.511527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:30.540292 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f31be-c86e-4734-ac70-678d17009d2f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.556381 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.559398 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.560412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.561608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] PATH_INFO: `/v3/users/1c19f16fd3bf497196d701715ecfc97d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.564971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c19f16fd3bf497196d701715ecfc97d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.572223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.574252 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309c4c-eb0d-425d-b8b9-490b18f48fb3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.580876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.582137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.582608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.583043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.584015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.586618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.635191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1094/2178] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:30 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:30.639486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.685033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c19f16fd3bf497196d701715ecfc97d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.701994 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c19f16fd3bf497196d701715ecfc97d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.704883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:30.714433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c19f16fd3bf497196d701715ecfc97d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.715569 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c19f16fd3bf497196d701715ecfc97d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.716496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c19f16fd3bf497196d701715ecfc97d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:30.740559 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1085/2179] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:30 2022] DELETE /identity/v3/users/1c19f16fd3bf497196d701715ecfc97d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:30.758964 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0e7f-ab49-4889-9230-7fd2fa94ed3e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.877794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.880248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.882552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.882864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.883775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.885800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:30.941936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1095/2180] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:30 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:30.945468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:30.954403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:30.979433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c8504-1c3b-433e-b24d-ecc85f65d926 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:30.987560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:30.988472 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:30.988875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:30.989245 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:30.990830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:30.993325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.009378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1086/2181] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:31.013975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:31.030916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204da6-62d9-41ec-b732-788cb5fb950a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:31.039321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab936a40-259b-480d-baab-90c07fa9569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:31.041207 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936a40-259b-480d-baab-90c07fa9569e admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.041719 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936a40-259b-480d-baab-90c07fa9569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.042284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936a40-259b-480d-baab-90c07fa9569e admin admin] PATH_INFO: `/v3/projects/e84819f793a0403393b2338e209432f1/users/49d6a80fc406416b8432ead0d4926bf3/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.090176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab936a40-259b-480d-baab-90c07fa9569e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84819f793a0403393b2338e209432f1, user_id=49d6a80fc406416b8432ead0d4926bf3, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:31.094472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab936a40-259b-480d-baab-90c07fa9569e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.117595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1096/2182] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:31 2022] PUT /identity/v3/projects/e84819f793a0403393b2338e209432f1/users/49d6a80fc406416b8432ead0d4926bf3/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:31.122838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:31.135909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2933317-80d9-426a-9e85-43ba8e958f77 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:31.161326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e5d4d-8b96-4eff-821d-34d4f4495f18 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.161651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e5d4d-8b96-4eff-821d-34d4f4495f18 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.161932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e5d4d-8b96-4eff-821d-34d4f4495f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.213802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b74e5d4d-8b96-4eff-821d-34d4f4495f18 None None] MFA Rules not processed for user `a39ac3a839ba470181b0466580fb5065`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:31.215113 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b74e5d4d-8b96-4eff-821d-34d4f4495f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.248103 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:31.261469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:31.262171 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.262446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.262716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.267421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:31.269201 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.306428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1087/2183] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:31.308410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:31.328340 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee88cf-ca59-442b-beba-304236ce341a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:31.340313 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:31.342919 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.343057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.343316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] PATH_INFO: `/v3/projects/e84819f793a0403393b2338e209432f1/users/49d6a80fc406416b8432ead0d4926bf3/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.346412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84819f793a0403393b2338e209432f1, user_id=49d6a80fc406416b8432ead0d4926bf3, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:31.350137 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.384359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1088/2184] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:31 2022] PUT /identity/v3/projects/e84819f793a0403393b2338e209432f1/users/49d6a80fc406416b8432ead0d4926bf3/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:31.387233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:31.392281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.401218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1097/2185] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:31.403515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.404028 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.404929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.442634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] MFA Rules not processed for user `49d6a80fc406416b8432ead0d4926bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:31.444005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.493763 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545305bf-1edf-47ce-a67c-333f94d0277e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:31.510655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:31.513713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.514151 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.514482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] PATH_INFO: `/v3/projects/15f324d599b64288baead91908aec6d6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.518144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f324d599b64288baead91908aec6d6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:31.523013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.524661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1098/2186] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:31.525636 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:31.527919 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.615085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f324d599b64288baead91908aec6d6', 'request_id': 'req-43c32c57-3348-4d9a-b9fa-f8750ac2344e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:31.639388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f324d599b64288baead91908aec6d6', 'request_id': 'req-43c32c57-3348-4d9a-b9fa-f8750ac2344e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:31.641384 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=3,keystone:DELETE=6,keystone:SELECT=91 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:31.649406 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f324d599b64288baead91908aec6d6', 'request_id': 'req-43c32c57-3348-4d9a-b9fa-f8750ac2344e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:31.657064 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f389-8a62-4611-9be8-48e64e315a61 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:31.677424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] The token cache is being invalidate because project 15f324d599b64288baead91908aec6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:31.677753 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:31.678444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:31.683832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1089/2187] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:31 2022] DELETE /identity/v3/projects/15f324d599b64288baead91908aec6d6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:31.683832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:31.683832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.762713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:31.763373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.763648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.763957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.771174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.780625 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:31.794209 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c32c57-3348-4d9a-b9fa-f8750ac2344e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:31.808623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:31.810154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.810154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.810154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.813059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:31.869527 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:31.884567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5258d-81a6-4ac9-88e2-d490b9e3e2e7 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.909658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1099/2188] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:31.912438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631467e-ef89-4332-b250-3b043b3bafb2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:31.912728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631467e-ef89-4332-b250-3b043b3bafb2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:31.913002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631467e-ef89-4332-b250-3b043b3bafb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:31.929399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:31.931680 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:31.961924 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1090/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:31.966181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a631467e-ef89-4332-b250-3b043b3bafb2 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:31.967664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a631467e-ef89-4332-b250-3b043b3bafb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:32.045237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.060599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dd928-6d16-4258-8604-21e5a96c6f96 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.071529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.073287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.073508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.073768 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.077806 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:32.130439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1100/2190] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:32.172851 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.173147 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.173426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.197419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:32.198895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:32.238172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1101/2191] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:32.240189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.245238 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.247513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.265660 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6559-e70a-4f84-9aed-14d1ecb89828 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.279291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1091/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:11:32.281547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.283539 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.286467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.287524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.291037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:32.293676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.298800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.329697 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1102/2193] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:32.334352 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.355400 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbffde-9bd7-4c25-97d6-be798bb69838 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.365480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.366081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.366359 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.366679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.367430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.373327 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.424876 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1092/2194] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:32 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:32.429297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.449031 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771176d5-5621-44c4-aebd-c6398db563ee admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.537456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.538254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.538728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.538931 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.540021 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.542381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.578308 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1103/2195] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:32 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:32.585120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.603098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44c69-e81f-4580-a3e6-f96c17cd1063 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.610795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.611666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.613367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.613367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.614122 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.616578 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.627296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:32.661641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1093/2196] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:32.665490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.682945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4be9-5f31-4f7d-bb6f-48eadf6b96d2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.700951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc61c0-fa35-4bc8-bf0f-2cb343ef0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.701790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc61c0-fa35-4bc8-bf0f-2cb343ef0637 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.702084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc61c0-fa35-4bc8-bf0f-2cb343ef0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.702445 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc61c0-fa35-4bc8-bf0f-2cb343ef0637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.703197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc61c0-fa35-4bc8-bf0f-2cb343ef0637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.704962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc61c0-fa35-4bc8-bf0f-2cb343ef0637 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.745507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:32.764198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1104/2197] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:32.778013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc68e-ca57-4096-b1f7-4d79db76ee21 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:32.791981 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:32.792952 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.793230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.793499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] PATH_INFO: `/v3/projects/08d84421d72f4fa0b21ed002f5d12cd5/users/ce9d948b0cd64384a14d363cbe9c5b21/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.842852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d84421d72f4fa0b21ed002f5d12cd5, user_id=ce9d948b0cd64384a14d363cbe9c5b21, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:32.845637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:32.883974 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1094/2198] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:32 2022] PUT /identity/v3/projects/08d84421d72f4fa0b21ed002f5d12cd5/users/ce9d948b0cd64384a14d363cbe9c5b21/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:32.887152 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e3f51-18de-4f86-a651-a9f54d73a1c7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:32.887824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e3f51-18de-4f86-a651-a9f54d73a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:32.888281 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e3f51-18de-4f86-a651-a9f54d73a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:32.898122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:32.958060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ab2e3f51-18de-4f86-a651-a9f54d73a1c7 None None] MFA Rules not processed for user `ce9d948b0cd64384a14d363cbe9c5b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:32.960836 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab2e3f51-18de-4f86-a651-a9f54d73a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:33.091342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1105/2199] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:33.101757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:33.172792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216f679-1518-43b8-b834-84cf3363e2bf admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:33.177262 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe605-c1bc-4554-928d-ea99dbf11bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:33.178072 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe605-c1bc-4554-928d-ea99dbf11bdb service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:33.178421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe605-c1bc-4554-928d-ea99dbf11bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:33.178899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe605-c1bc-4554-928d-ea99dbf11bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:33.190913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe605-c1bc-4554-928d-ea99dbf11bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:33.192837 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe605-c1bc-4554-928d-ea99dbf11bdb service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:33.209247 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1095/2200] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:33.872427 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:33.873385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:33.873999 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:33.915032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] MFA Rules not processed for user `a39ac3a839ba470181b0466580fb5065`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:33.918327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:34.019120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1106/2201] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:36.273871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:36.274401 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:36.275477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:36.295098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:36.297875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:36.314363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] MFA Rules not processed for user `3d3b0e71ebb447c1877183c931812ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:36.315508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:36.441053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1096/2202] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:36.447256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c1db5-6b20-4719-9e9f-7d504eae536b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:36.453204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:36.454110 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:36.454392 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:36.454667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] PATH_INFO: `/v3/users/8a5d449fcaca49df891511e0de184c3c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:36.456581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5d449fcaca49df891511e0de184c3c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:36.458155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:36.458597 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:36.462269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:36.532562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:36.539815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5d449fcaca49df891511e0de184c3c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:36.560802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5d449fcaca49df891511e0de184c3c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:36.571519 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796964d-5d2d-4cc3-bfac-44bafa14b017 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:36.584088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ffa76-54a9-450b-ad13-89a0f1452916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:36.585063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffa76-54a9-450b-ad13-89a0f1452916 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:36.585691 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffa76-54a9-450b-ad13-89a0f1452916 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:36.586205 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffa76-54a9-450b-ad13-89a0f1452916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:36.587276 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5d449fcaca49df891511e0de184c3c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:36.588338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5d449fcaca49df891511e0de184c3c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:36.593130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:36.601016 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ffa76-54a9-450b-ad13-89a0f1452916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:36.602677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ffa76-54a9-450b-ad13-89a0f1452916 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:36.612116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5d449fcaca49df891511e0de184c3c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:36.628069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1097/2203] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:36.632512 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1107/2204] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:36 2022] DELETE /identity/v3/users/8a5d449fcaca49df891511e0de184c3c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:36.637190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:36.637655 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:36.638155 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:36.672978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:36.674290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:36.788190 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1098/2205] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:36.822742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:36.824291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:36.917553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999141-4d0c-47bb-bafc-36b3d3c6458c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:36.921626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:36.922389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:36.922665 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:36.922939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:36.934341 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:36.936674 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:36.948543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1108/2206] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:37.687769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:37.689564 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:37.708805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f817-6693-4ac6-a6dd-5d95e34ace3e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:37.714476 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:37.715535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:37.715814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:37.716121 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] PATH_INFO: `/v3/projects/eb4e4799ddfe4686b3fe393cf967eff9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:37.717354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4e4799ddfe4686b3fe393cf967eff9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:37.719296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:37.776439 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4e4799ddfe4686b3fe393cf967eff9', 'request_id': 'req-a40949c9-629c-42b7-b803-49ec6149105b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.784978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4e4799ddfe4686b3fe393cf967eff9', 'request_id': 'req-a40949c9-629c-42b7-b803-49ec6149105b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.792098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4e4799ddfe4686b3fe393cf967eff9', 'request_id': 'req-a40949c9-629c-42b7-b803-49ec6149105b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.802931 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] The token cache is being invalidate because project eb4e4799ddfe4686b3fe393cf967eff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:37.803217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.803942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.805741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1099/2207] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:37 2022] DELETE /identity/v3/projects/eb4e4799ddfe4686b3fe393cf967eff9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:37.809477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:37.821729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dd7f2-087c-451f-87a6-c853c5eef9d7 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:37.897387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:37.898573 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:37.899067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:37.899713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] PATH_INFO: `/v3/users/49d6a80fc406416b8432ead0d4926bf3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:37.901312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d6a80fc406416b8432ead0d4926bf3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:37.903390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:37.964987 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d6a80fc406416b8432ead0d4926bf3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.977915 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:37.979250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d6a80fc406416b8432ead0d4926bf3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.990689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d6a80fc406416b8432ead0d4926bf3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:37.991809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d6a80fc406416b8432ead0d4926bf3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:38.003304 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7df48169-b1d4-4fc1-a84b-4104014a0ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d6a80fc406416b8432ead0d4926bf3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:38.014680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1109/2208] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:37 2022] DELETE /identity/v3/users/49d6a80fc406416b8432ead0d4926bf3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:38.896440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:38.898033 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:38.921453 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40949c9-629c-42b7-b803-49ec6149105b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:39.092048 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:39.093600 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:39.093891 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:39.094169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] PATH_INFO: `/v3/projects/e84819f793a0403393b2338e209432f1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:39.095917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84819f793a0403393b2338e209432f1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:39.114064 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:39.171275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:39.254526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84819f793a0403393b2338e209432f1', 'request_id': 'req-c2064901-7991-4411-a0a2-66bc32840699'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:39.275408 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84819f793a0403393b2338e209432f1', 'request_id': 'req-c2064901-7991-4411-a0a2-66bc32840699'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:39.300038 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84819f793a0403393b2338e209432f1', 'request_id': 'req-c2064901-7991-4411-a0a2-66bc32840699'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:39.351833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] The token cache is being invalidate because project e84819f793a0403393b2338e209432f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:39.352490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:39.357139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c2064901-7991-4411-a0a2-66bc32840699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:39.362888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1100/2209] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:38 2022] DELETE /identity/v3/projects/e84819f793a0403393b2338e209432f1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:39.368386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:39.368880 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:39.368959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:39.434840 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:39.441482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:39.644985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1110/2210] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:39.653978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:39.654832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:39.655321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:39.696496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:39.698139 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:39.707654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1101/2211] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:39.711925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:39.724731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890444a-be9c-4d95-95c5-c06e37d74f13 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:39.741079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:39.741874 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:39.742224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:39.742565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:39.743651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:39.744051 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:39.746848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:39.767318 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1111/2212] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:39.772546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:39.818214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86415770-5cb9-492a-9d40-f2081da78bf7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:39.841682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:39.842602 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:39.842884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:39.843159 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:39.843885 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:39.846886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:39.921250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1102/2213] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:39 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:39.923466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:39.940389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931d676-48f2-45f9-9042-ad2b9d110330 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.072461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.073309 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.073656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.074002 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.074935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.077406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.117115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1112/2214] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:39 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:40.118191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.145415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89be3-4d69-485a-9ddb-9475ece0276c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.164797 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.165692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.166063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.166433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.167299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.170867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.171467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.173457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:40.186026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1103/2215] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:40.191184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36df62-527d-4b11-8901-a02b59306373 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.193199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.199307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.200289 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.200592 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.200870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] PATH_INFO: `/v3/users/ce9d948b0cd64384a14d363cbe9c5b21` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.203540 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9d948b0cd64384a14d363cbe9c5b21)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.205672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.209013 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d38e59-90fe-447c-bd60-4ed86b567ec4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.214901 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.217596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.218077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.218531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.219796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.222195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.237652 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1104/2216] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:40.242930 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.256198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674d48-84d4-423c-8984-f6ca0e18ea5c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.266030 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2137e-23e8-4dd0-b086-1db05dcf5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.267325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2137e-23e8-4dd0-b086-1db05dcf5e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.267609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2137e-23e8-4dd0-b086-1db05dcf5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.267909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2137e-23e8-4dd0-b086-1db05dcf5e4d admin admin] PATH_INFO: `/v3/projects/5cb2101bea8241a0b11f6090d4c8494a/users/f59b1624f692484d93d664bddc8deebd/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.278743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9d948b0cd64384a14d363cbe9c5b21'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:40.285730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2137e-23e8-4dd0-b086-1db05dcf5e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb2101bea8241a0b11f6090d4c8494a, user_id=f59b1624f692484d93d664bddc8deebd, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.287608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:40.288561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2137e-23e8-4dd0-b086-1db05dcf5e4d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.302190 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9d948b0cd64384a14d363cbe9c5b21'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:40.313118 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1105/2217] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:40 2022] PUT /identity/v3/projects/5cb2101bea8241a0b11f6090d4c8494a/users/f59b1624f692484d93d664bddc8deebd/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:40.321637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9d948b0cd64384a14d363cbe9c5b21'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:40.322286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9d948b0cd64384a14d363cbe9c5b21'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:40.324692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.324979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.325252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.337417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9c41b7b3-ed15-4df9-a5f3-6cf166447e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9d948b0cd64384a14d363cbe9c5b21'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:40.352585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1113/2218] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:40 2022] DELETE /identity/v3/users/ce9d948b0cd64384a14d363cbe9c5b21 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:40.354635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.355018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.355465 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.357762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] MFA Rules not processed for user `f59b1624f692484d93d664bddc8deebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:40.359293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:40.381800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:40.387242 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:40.453455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1106/2219] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:40.454646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.456059 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:40.483535 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1114/2220] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:40.493905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:40.495292 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.498641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:40.548103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccba72-1c36-40b7-89b3-c7fa8b4af7b6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.553807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.554663 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.554951 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.555285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.556075 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.558444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.583015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74127cc-6387-453f-9fc7-fca3a2c89baf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.588018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.588946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.589644 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.590055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.604551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.605455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1107/2221] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:40 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:40.608978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.611429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.636339 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1115/2222] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:40.730737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be28fb-174d-476d-864b-808d1a95de62 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.736648 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.737490 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.737868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.738276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.739195 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.741297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.777933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1108/2223] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:40 2022] POST /identity/v3/users => generated 306 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:40.782114 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.802884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676ee8-0e5b-4fcf-b80d-d93030782b90 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.810845 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.812052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.812419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.812698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.814869 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.817038 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.834196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1116/2224] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:40.839572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.856379 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb47a4b-ce57-4743-9249-0c76e8ebe1fd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:40.865610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:40.868187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:40.868580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:40.869311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] PATH_INFO: `/v3/projects/a22d4c52272144a987b82d31ee667f3e/users/044fabe94b9b4ab28d8f8b1631dcb376/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:40.904082 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22d4c52272144a987b82d31ee667f3e, user_id=044fabe94b9b4ab28d8f8b1631dcb376, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:40.908523 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:40.948060 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1109/2225] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:40 2022] PUT /identity/v3/projects/a22d4c52272144a987b82d31ee667f3e/users/044fabe94b9b4ab28d8f8b1631dcb376/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:40.952048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:40.964580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89eb9-0e3c-4653-8606-496316678287 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.121695 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.123163 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.124039 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.124326 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.128452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:41.134219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:41.147560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:41.202714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1117/2226] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:41.210827 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.243726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48e1f-947d-43bf-9db7-1a4507733320 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.283418 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.285288 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.293596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c835c-b4f7-40d8-9dc9-0d9f5eb3641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.294979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c835c-b4f7-40d8-9dc9-0d9f5eb3641f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.295910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c835c-b4f7-40d8-9dc9-0d9f5eb3641f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.297022 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c835c-b4f7-40d8-9dc9-0d9f5eb3641f admin admin] PATH_INFO: `/v3/projects/a22d4c52272144a987b82d31ee667f3e/users/044fabe94b9b4ab28d8f8b1631dcb376/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.308175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c835c-b4f7-40d8-9dc9-0d9f5eb3641f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22d4c52272144a987b82d31ee667f3e, user_id=044fabe94b9b4ab28d8f8b1631dcb376, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:41.314386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60fffe-ff30-4677-b62c-a96aad506464 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.317957 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c835c-b4f7-40d8-9dc9-0d9f5eb3641f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:41.330728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.331675 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.332106 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.332269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] PATH_INFO: `/v3/projects/08d84421d72f4fa0b21ed002f5d12cd5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.349572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d84421d72f4fa0b21ed002f5d12cd5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:41.354224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:41.363917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1110/2227] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:41 2022] PUT /identity/v3/projects/a22d4c52272144a987b82d31ee667f3e/users/044fabe94b9b4ab28d8f8b1631dcb376/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:41.375435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098071-76cd-4b73-959f-ad67641afa52 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.375762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098071-76cd-4b73-959f-ad67641afa52 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.376081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098071-76cd-4b73-959f-ad67641afa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.412931 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d9098071-76cd-4b73-959f-ad67641afa52 None None] MFA Rules not processed for user `044fabe94b9b4ab28d8f8b1631dcb376`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:41.414912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d9098071-76cd-4b73-959f-ad67641afa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.507927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d84421d72f4fa0b21ed002f5d12cd5', 'request_id': 'req-e6564723-2e30-4964-a255-02608a2feb63'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:41.522255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d84421d72f4fa0b21ed002f5d12cd5', 'request_id': 'req-e6564723-2e30-4964-a255-02608a2feb63'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:41.529003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:41.540208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d84421d72f4fa0b21ed002f5d12cd5', 'request_id': 'req-e6564723-2e30-4964-a255-02608a2feb63'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:41.568062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] The token cache is being invalidate because project 08d84421d72f4fa0b21ed002f5d12cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:41.568680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:41.569490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:41.573532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1111/2228] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:41.573532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8525b3-2dd4-4743-80b4-bcc03c571fd5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.573532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8525b3-2dd4-4743-80b4-bcc03c571fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.573532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8525b3-2dd4-4743-80b4-bcc03c571fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.587212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1118/2229] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:41 2022] DELETE /identity/v3/projects/08d84421d72f4fa0b21ed002f5d12cd5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:41.587212 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.588240 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.595699 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-af8525b3-2dd4-4743-80b4-bcc03c571fd5 None None] MFA Rules not processed for user `3d3b0e71ebb447c1877183c931812ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:41.597077 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af8525b3-2dd4-4743-80b4-bcc03c571fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.684315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1112/2230] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:41.686300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729ef1c-7287-4a38-83b3-f0a3b8eb2968 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.686593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729ef1c-7287-4a38-83b3-f0a3b8eb2968 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.686869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729ef1c-7287-4a38-83b3-f0a3b8eb2968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.707098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6729ef1c-7287-4a38-83b3-f0a3b8eb2968 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:41.708306 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6729ef1c-7287-4a38-83b3-f0a3b8eb2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.727858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564723-2e30-4964-a255-02608a2feb63 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.727858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.727858 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.728925 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.729235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.737192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.773172 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1113/2231] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:41.782630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.783001 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.783339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.810158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:41.811665 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.821342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1114/2232] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:41.825993 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.836618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:41.837101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe795c4-7d1f-4bfe-b90b-7ab34bbe263a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.838235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:41.844394 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.850819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1119/2233] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:41.853846 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.854609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.854904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.855726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:41.856110 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:41.857921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:41.898605 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1115/2234] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:41.902737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.917702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22741c-68b2-4ad1-b669-0c61231416ae service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.926184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.927089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.927534 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.927793 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.928601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:41.930861 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:41.943664 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.954904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef251d-40f1-4fc8-aa03-9979ea240b5d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:41.958670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:41.959312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:41.959599 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:41.959910 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:41.961842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:41.969203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1120/2235] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:41 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:41.970552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:41.996481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:42.038045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:42.039641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:42.049657 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1116/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:42.065818 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46b55-72cd-4b0e-bf89-4f3fa9523e92 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:42.071990 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:42.072803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:42.073087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:42.073417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:42.075284 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:42.076553 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:42.099385 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1121/2237] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:41 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:42.103983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:42.120953 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a0f7d-4268-4a48-97b9-628bd97dc151 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:42.136587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:42.137275 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:42.137561 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:42.137838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:42.138585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:42.140241 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:42.143450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:42.153716 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1117/2238] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:42.157794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:42.168431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d31c76-70f4-4aaa-9aee-6c7b14bbff70 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:42.174181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa4adf-02d2-4bfc-90cd-ef43adcd7275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:42.175224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4adf-02d2-4bfc-90cd-ef43adcd7275 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:42.175586 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4adf-02d2-4bfc-90cd-ef43adcd7275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:42.175957 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4adf-02d2-4bfc-90cd-ef43adcd7275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:42.176860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa4adf-02d2-4bfc-90cd-ef43adcd7275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:42.178551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa4adf-02d2-4bfc-90cd-ef43adcd7275 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:42.192086 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1122/2239] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:42.194161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:42.207412 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcae41-f2b6-4949-81ca-eb0f00d90fcd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:42.213933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:42.215134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:42.215454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:42.215745 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] PATH_INFO: `/v3/projects/de21fc951fb84aa5a63f6b1800ca9eca/users/a5cb7222b9b243a091ab0f1257d4aceb/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:42.243481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de21fc951fb84aa5a63f6b1800ca9eca, user_id=a5cb7222b9b243a091ab0f1257d4aceb, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:42.250687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:42.264585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1118/2240] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:42 2022] PUT /identity/v3/projects/de21fc951fb84aa5a63f6b1800ca9eca/users/a5cb7222b9b243a091ab0f1257d4aceb/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:42.270567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:42.271099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:42.272323 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:42.296342 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:42.297780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:42.437973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1123/2241] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:42.455917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:42.455917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:42.524983 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6fbbf-eec6-4fbf-b769-e7394b31fa65 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:42.528700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752720-c98d-44fd-ae2b-ec11e8440bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:42.529431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752720-c98d-44fd-ae2b-ec11e8440bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:42.529773 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752720-c98d-44fd-ae2b-ec11e8440bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:42.530109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752720-c98d-44fd-ae2b-ec11e8440bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:42.539758 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752720-c98d-44fd-ae2b-ec11e8440bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:42.541242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752720-c98d-44fd-ae2b-ec11e8440bf8 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:42.551407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1119/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:48.909847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:48.912560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:48.931466 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b70b-80e6-4c09-981f-db00e1eb1349 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:48.937189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:48.938760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:48.939266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:48.939542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] PATH_INFO: `/v3/users/f59b1624f692484d93d664bddc8deebd` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:48.940929 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59b1624f692484d93d664bddc8deebd)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:48.943455 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:49.022703 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59b1624f692484d93d664bddc8deebd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:49.039243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59b1624f692484d93d664bddc8deebd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:49.050166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59b1624f692484d93d664bddc8deebd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:49.050864 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59b1624f692484d93d664bddc8deebd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:49.059559 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59b1624f692484d93d664bddc8deebd'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:49.062244 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:49.070177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1124/2243] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:48 2022] DELETE /identity/v3/users/f59b1624f692484d93d664bddc8deebd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:49.071959 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef8e86-a001-4202-8c01-09e2dfa8f3cf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.072823 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef8e86-a001-4202-8c01-09e2dfa8f3cf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.073320 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef8e86-a001-4202-8c01-09e2dfa8f3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.096403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-60ef8e86-a001-4202-8c01-09e2dfa8f3cf None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:49.097812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-60ef8e86-a001-4202-8c01-09e2dfa8f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:49.209828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1120/2244] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:49.222115 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:49.225314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:49.236315 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.236764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.236863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.281120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] MFA Rules not processed for user `a5cb7222b9b243a091ab0f1257d4aceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:49.282363 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:49.359155 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaee8d-c909-4639-8e29-7d28a6e1758f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:49.364285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:49.364962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.365238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.365505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.401483 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:49.404693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:49.455253 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1125/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:49.482401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:49.483606 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1121/2246] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:49.487295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:49.515364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71a143-ac59-4c06-8507-f9972eb44af3 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:49.526908 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:49.527519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.530032 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.530343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.531076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:49.535593 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:49.600428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:49.608830 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1126/2247] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:49 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:49.616370 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849eae41-3d3f-4309-bbab-3224495614a9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:49.628099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:49.768403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:49.769217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.769485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.769739 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.770466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:49.773271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:49.827298 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:49.834164 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1122/2248] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:49 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:49.841216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942a3ed-9850-4a86-a62f-38f155e43a1d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:49.848306 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:49.849464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.849885 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.850462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.851439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:49.854356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:49.870117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1127/2249] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:49.874252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:49.886389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b2d90-bda9-4b51-8e9f-b6f72a4cfab0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:49.899281 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:49.900307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:49.900592 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:49.900863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] PATH_INFO: `/v3/projects/bb3ec467a1604cbab00efbf8be7d62dc/users/706b0570c62e46c791c9fdd7e3caf7ba/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:49.937805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3ec467a1604cbab00efbf8be7d62dc, user_id=706b0570c62e46c791c9fdd7e3caf7ba, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:49.941935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:49.962623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1123/2250] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:49 2022] PUT /identity/v3/projects/bb3ec467a1604cbab00efbf8be7d62dc/users/706b0570c62e46c791c9fdd7e3caf7ba/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:49.967684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:49.984633 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce892b18-0589-464c-bc72-f0e4760882e9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:50.052449 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:50.054311 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:50.121446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:50.122059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:50.122343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:50.122628 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:50.123367 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:50.125042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:50.148097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1128/2251] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:50.152575 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:50.182617 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363183a9-1317-4865-b589-ffd99723b8b1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:50.186726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af1b2-4ab8-4b23-aa1a-e23539553a7d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:50.188595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:50.189530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:50.189813 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:50.190091 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] PATH_INFO: `/v3/projects/bb3ec467a1604cbab00efbf8be7d62dc/users/706b0570c62e46c791c9fdd7e3caf7ba/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:50.193420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:50.195003 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:50.195446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:50.196168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] PATH_INFO: `/v3/projects/5cb2101bea8241a0b11f6090d4c8494a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:50.197675 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb2101bea8241a0b11f6090d4c8494a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:50.202517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3ec467a1604cbab00efbf8be7d62dc, user_id=706b0570c62e46c791c9fdd7e3caf7ba, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:50.205071 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:50.205280 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:50.228771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1129/2252] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:50 2022] PUT /identity/v3/projects/bb3ec467a1604cbab00efbf8be7d62dc/users/706b0570c62e46c791c9fdd7e3caf7ba/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:50.348761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb2101bea8241a0b11f6090d4c8494a', 'request_id': 'req-2f228179-9417-4552-8607-a11d6e18f6eb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.365630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb2101bea8241a0b11f6090d4c8494a', 'request_id': 'req-2f228179-9417-4552-8607-a11d6e18f6eb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.374820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb2101bea8241a0b11f6090d4c8494a', 'request_id': 'req-2f228179-9417-4552-8607-a11d6e18f6eb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.402926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] The token cache is being invalidate because project 5cb2101bea8241a0b11f6090d4c8494a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:50.407791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.415688 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.419100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1124/2253] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:50 2022] DELETE /identity/v3/projects/5cb2101bea8241a0b11f6090d4c8494a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:50.423626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:50.425495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:50.528580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:50.544149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8db3-a2e9-46d7-acbd-3c6baf6f528a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:50.669129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:50.670267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:50.670554 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:50.670952 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] PATH_INFO: `/v3/users/044fabe94b9b4ab28d8f8b1631dcb376` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:50.674712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=044fabe94b9b4ab28d8f8b1631dcb376)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:50.683291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:50.787777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:50.794023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:50.810684 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:50.830573 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f228179-9417-4552-8607-a11d6e18f6eb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:50.834510 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044fabe94b9b4ab28d8f8b1631dcb376'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.838751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:50.840217 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:50.840814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:50.840814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] PATH_INFO: `/v3/users/3711e909bb5f49c799c093b80b287fa9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:50.842909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3711e909bb5f49c799c093b80b287fa9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:50.845871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:50.889699 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044fabe94b9b4ab28d8f8b1631dcb376'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.912653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044fabe94b9b4ab28d8f8b1631dcb376'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.913279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044fabe94b9b4ab28d8f8b1631dcb376'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.942948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2681d4cf-c0c5-4d83-aabb-57c28a06abbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044fabe94b9b4ab28d8f8b1631dcb376'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:50.959969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1130/2254] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:50 2022] DELETE /identity/v3/users/044fabe94b9b4ab28d8f8b1631dcb376 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:50.973324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3711e909bb5f49c799c093b80b287fa9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:51.001754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3711e909bb5f49c799c093b80b287fa9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:51.023358 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3711e909bb5f49c799c093b80b287fa9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:51.024259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3711e909bb5f49c799c093b80b287fa9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:51.024921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3711e909bb5f49c799c093b80b287fa9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:51.075273 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1125/2255] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:11:50 2022] DELETE /identity/v3/users/3711e909bb5f49c799c093b80b287fa9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:51.080179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:51.080629 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:51.080799 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:51.108993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:51.110658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:51.276714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1131/2256] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:51.313690 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:51.317572 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:51.504601 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a2904-d45a-4c23-8105-fe98b17a5f6d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:51.509820 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f71910-a561-4509-a80b-b5035da245b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:51.510934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71910-a561-4509-a80b-b5035da245b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:51.511510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71910-a561-4509-a80b-b5035da245b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:51.512024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71910-a561-4509-a80b-b5035da245b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:51.542049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f71910-a561-4509-a80b-b5035da245b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:51.544708 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f71910-a561-4509-a80b-b5035da245b9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:51.565295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1126/2257] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:51.879379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:51.880800 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:51.893055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cac45a-b90a-4241-ad08-e9b8eccaa379 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:51.910271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:51.915365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:51.916740 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:51.917128 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] PATH_INFO: `/v3/projects/a22d4c52272144a987b82d31ee667f3e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:51.918700 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22d4c52272144a987b82d31ee667f3e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:51.920881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:51.957396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:52.045324 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22d4c52272144a987b82d31ee667f3e', 'request_id': 'req-0c4804bb-89fd-4071-a584-8c065168fefa'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.064760 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22d4c52272144a987b82d31ee667f3e', 'request_id': 'req-0c4804bb-89fd-4071-a584-8c065168fefa'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.079082 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22d4c52272144a987b82d31ee667f3e', 'request_id': 'req-0c4804bb-89fd-4071-a584-8c065168fefa'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.101135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] The token cache is being invalidate because project a22d4c52272144a987b82d31ee667f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:52.102170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.103118 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0c4804bb-89fd-4071-a584-8c065168fefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.110504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.110721 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1132/2258] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:51 2022] DELETE /identity/v3/projects/a22d4c52272144a987b82d31ee667f3e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:52.110926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.111289 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.135256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:52.136879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:52.260932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1127/2259] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:52.269572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.269853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.270331 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.290467 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:52.292291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:52.324560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1133/2260] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:52.325766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:52.344079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e59e0b-1e68-4824-b89b-dbdac5635203 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:52.356900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:52.365702 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.366035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.366465 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.367269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:52.368168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:52.372020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:52.421897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1128/2261] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:11:52.428185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:52.443439 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34035bd8-37f8-44f7-882f-4f40fda0ab50 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:52.451025 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:52.452241 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.452536 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.452942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.454183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:52.456454 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:52.489504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:52.491646 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:52.513989 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e4ba-2ea7-4da9-a18c-8a1e0112e1f2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:52.514623 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:52.531582 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:52.533008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.533921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.534435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] PATH_INFO: `/v3/projects/d4b3a0c457d14f19a7af320462a4af61` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.537992 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b3a0c457d14f19a7af320462a4af61)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:52.542106 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:52.548567 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1134/2262] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:52 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:52.550443 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:52.678114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b3a0c457d14f19a7af320462a4af61', 'request_id': 'req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.708242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b3a0c457d14f19a7af320462a4af61', 'request_id': 'req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.722641 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b3a0c457d14f19a7af320462a4af61', 'request_id': 'req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.744274 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b0e6-4a5c-47b0-b88e-45eccd8c5a27 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:52.760330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] The token cache is being invalidate because project d4b3a0c457d14f19a7af320462a4af61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:11:52.760682 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.761447 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1ec690ca-20df-4d2e-9e90-d4b021ccfd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:11:52.768810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1129/2263] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:11:52 2022] DELETE /identity/v3/projects/d4b3a0c457d14f19a7af320462a4af61 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:52.770579 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321351e-66aa-497b-a0a4-5bb98cd1d23f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.770867 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321351e-66aa-497b-a0a4-5bb98cd1d23f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.771141 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321351e-66aa-497b-a0a4-5bb98cd1d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.839444 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8321351e-66aa-497b-a0a4-5bb98cd1d23f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:52.840321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8321351e-66aa-497b-a0a4-5bb98cd1d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:52.894401 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:52.895105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:52.895387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:52.895664 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:52.896525 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:52.898576 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:52.977267 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1135/2264] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:52 2022] POST /identity/v3/users => generated 289 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:11:52.982126 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:52.984020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:53.010169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1130/2265] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:53.016882 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b825ac-283a-4572-9fb8-adde022250b7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.023027 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.024979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.025435 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.040468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.041195 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.041484 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.041748 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.042517 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.050921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.062245 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:53.085146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1136/2266] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:11:53.088352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.091771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:53.093063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:53.121481 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1131/2267] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:53.125660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.126184 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1a37-e537-408f-92e3-6d485bde26fa admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.137248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.138460 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.139518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.140172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.141146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.143374 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.157012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9c298-f538-4337-bee2-6c5fd1a885c3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.178996 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1137/2268] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:53.179812 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.184103 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.184317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.185378 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.191526 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.192508 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:11:53.197337 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.206153 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.206928 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb3499-fa4d-4ee8-9c00-80f991ec2879 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.223887 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f533b3-2bc0-4010-aeb5-70b062235256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.225158 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f533b3-2bc0-4010-aeb5-70b062235256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.225775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f533b3-2bc0-4010-aeb5-70b062235256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.226243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f533b3-2bc0-4010-aeb5-70b062235256 admin admin] PATH_INFO: `/v3/projects/bbb88962f3344c8c89ac2aa47f11d715/users/48c568162cab4ae7a9e0ffce92599b27/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.254805 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1132/2269] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:11:53.260403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.288892 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f533b3-2bc0-4010-aeb5-70b062235256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb88962f3344c8c89ac2aa47f11d715, user_id=48c568162cab4ae7a9e0ffce92599b27, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.292451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f533b3-2bc0-4010-aeb5-70b062235256 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.325907 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1138/2270] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:53 2022] PUT /identity/v3/projects/bbb88962f3344c8c89ac2aa47f11d715/users/48c568162cab4ae7a9e0ffce92599b27/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:53.332969 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268ea4-d45a-42ab-a296-2f13a6345bd0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.338630 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.339135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.340092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.401837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] MFA Rules not processed for user `48c568162cab4ae7a9e0ffce92599b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:53.404691 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:53.477083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.477978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.478746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.479333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.480782 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.482904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.502482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:53.528677 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1133/2271] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:53 2022] POST /identity/v3/projects => generated 371 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:53.532347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.675718 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1139/2272] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:53.676771 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.693526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80877f-985b-4856-b7d2-91e8f4342654 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.716324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7a940-06a0-4a3e-90cf-c59e02ca68fc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.730884 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.731588 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.731886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.732173 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.732887 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.737670 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.802528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1134/2273] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:53 2022] POST /identity/v3/users => generated 286 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:53.811430 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.842244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f254-237b-4d70-aa4f-e69d3817a27a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.859914 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.862215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.862496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.862774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.863524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.872409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.880191 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.884730 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.885043 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.885356 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:53.890065 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:53.892416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:53.917883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1135/2274] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:53.929095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:53.970552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8c9d3-2b7f-4d50-97a2-c9a87ab29b24 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:53.993423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:53.994117 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:53.994399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:53.994676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.006402 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:54.007912 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:54.026689 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1140/2275] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:53 2022] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:54.027606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:54.077864 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1136/2276] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:54.090062 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:54.166911 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214eeb4-e94c-4e2a-8b9d-6241d58775d2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:54.196543 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:54.265710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1574a4-d062-4f2b-b94f-d1ed96fb0c7c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:54.296656 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:54.297622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.298056 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.298509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.299671 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:54.304803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:54.365272 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1141/2277] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:54 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:54.366444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:54.394710 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f964-6698-4424-a884-2ca81bcbbfe8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:54.414087 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef660215-d377-4cbb-b57c-e3d3c0a93536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:54.414714 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:54.414836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660215-d377-4cbb-b57c-e3d3c0a93536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.414934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.415026 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660215-d377-4cbb-b57c-e3d3c0a93536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.415120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.415120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.416474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660215-d377-4cbb-b57c-e3d3c0a93536 admin admin] PATH_INFO: `/v3/projects/5781e2ee0c3b45488de7935539b317ed/users/a52806b021904e74add823c048c3a9b1/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.416595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:54.424594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:54.462640 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1142/2278] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:54.463685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:54.499314 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef660215-d377-4cbb-b57c-e3d3c0a93536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5781e2ee0c3b45488de7935539b317ed, user_id=a52806b021904e74add823c048c3a9b1, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:54.503566 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575cbb6-e1ea-4b2b-b6e5-234748e98953 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:54.508722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef660215-d377-4cbb-b57c-e3d3c0a93536 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:54.521679 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:54.522451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.523124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.524290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.524290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:54.525951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:54.549044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1137/2279] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:54 2022] PUT /identity/v3/projects/5781e2ee0c3b45488de7935539b317ed/users/a52806b021904e74add823c048c3a9b1/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:54.557933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1143/2280] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:54.561069 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:54.562114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.562565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.562975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.596049 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce969d5-247e-4281-8b3a-5ffc153b61c4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:54.639879 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] MFA Rules not processed for user `a52806b021904e74add823c048c3a9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:54.644166 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:54.716097 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3e4b-172f-4057-b2fb-f50fbd0c6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:54.716856 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:54.717635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3e4b-172f-4057-b2fb-f50fbd0c6977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.718084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3e4b-172f-4057-b2fb-f50fbd0c6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.718531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3e4b-172f-4057-b2fb-f50fbd0c6977 admin admin] PATH_INFO: `/v3/projects/845f0e6c2265441780266506088e86be/users/901c1ab57324434ca3281a3f6e7f03ea/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.744600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e3e4b-172f-4057-b2fb-f50fbd0c6977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845f0e6c2265441780266506088e86be, user_id=901c1ab57324434ca3281a3f6e7f03ea, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:54.748945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e3e4b-172f-4057-b2fb-f50fbd0c6977 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:54.764836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1138/2281] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:54.779362 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:54.781308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:54.786362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1144/2282] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:54 2022] PUT /identity/v3/projects/845f0e6c2265441780266506088e86be/users/901c1ab57324434ca3281a3f6e7f03ea/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:54.797835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.798402 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.798736 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:54.876111 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452de21-b4f3-42d6-b3b9-dcd5ea2785f5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:54.930393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] MFA Rules not processed for user `901c1ab57324434ca3281a3f6e7f03ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:54.931678 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:54.988520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:54.989841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:54.990270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:54.990669 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:55.119049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:55.123296 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:55.166108 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1139/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:55.241223 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1145/2284] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:11:55.243528 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:55.432181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:55.496802 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde20f2f-8b4f-44a8-850c-5709ac6fcf05 service glance] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:55.518527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:55.519306 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:55.529643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:55.529947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:55.540473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:55.545146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:55.613669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:55.615301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1140/2285] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:11:55 2022] POST /identity/v3/projects => generated 375 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:55.626456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a8dd4-8128-45b6-b740-83b4340af0ec None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:55.669792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:55.738183 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:55.739127 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:55.739515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:55.739918 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:55.741047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:55.743174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:55.787546 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:55.794754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1146/2286] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:11:55 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:11:55.801226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06089e-440e-4fb5-bc10-609c0880a78e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:55.811906 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:55.818206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:55.818899 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:55.819790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:55.821107 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:55.823028 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:55.856389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1141/2287] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:55.860511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:55.876181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7bf73-82df-4be5-bb66-3aa6dbd30673 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:55.892653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:55.893601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:55.893884 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:55.894161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] PATH_INFO: `/v3/projects/bfd7f9a3aff44b6e8781d7477485446c/users/536abc87b22b4694b02d3d12d6e74aa7/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:55.943353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd7f9a3aff44b6e8781d7477485446c, user_id=536abc87b22b4694b02d3d12d6e74aa7, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:55.946221 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:55.989112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:55.989959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1147/2288] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:55 2022] PUT /identity/v3/projects/bfd7f9a3aff44b6e8781d7477485446c/users/536abc87b22b4694b02d3d12d6e74aa7/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:11:56.002584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dae1a-6b0f-4af1-b91c-122c08a2b6c0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:56.121587 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94d917-d278-46c1-9282-2330b06cba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:56.126730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94d917-d278-46c1-9282-2330b06cba6f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:56.128116 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94d917-d278-46c1-9282-2330b06cba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:56.131040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94d917-d278-46c1-9282-2330b06cba6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:56.132616 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94d917-d278-46c1-9282-2330b06cba6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:56.136941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94d917-d278-46c1-9282-2330b06cba6f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:56.162208 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:56.168503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1142/2289] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:11:56.177432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8428685-f12f-4a60-8eb6-2081c6303b2e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:56.192786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:56.194657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:56.195154 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:56.195803 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] PATH_INFO: `/v3/projects/bfd7f9a3aff44b6e8781d7477485446c/users/536abc87b22b4694b02d3d12d6e74aa7/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:56.198255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd7f9a3aff44b6e8781d7477485446c, user_id=536abc87b22b4694b02d3d12d6e74aa7, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:56.201805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:56.234336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:56.234954 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:56.235348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:56.242542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1148/2290] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:11:56 2022] PUT /identity/v3/projects/bfd7f9a3aff44b6e8781d7477485446c/users/536abc87b22b4694b02d3d12d6e74aa7/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:11:56.302813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] MFA Rules not processed for user `536abc87b22b4694b02d3d12d6e74aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:11:56.304386 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:56.553886 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1143/2291] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:11:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:11:56.566776 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:56.569778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:56.704377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44380-f6b5-46c1-9860-8536983398fe admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:56.712733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7651-1d4e-47fc-ae9d-cc5543018f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:56.713412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7651-1d4e-47fc-ae9d-cc5543018f63 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:56.713707 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7651-1d4e-47fc-ae9d-cc5543018f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:56.713977 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7651-1d4e-47fc-ae9d-cc5543018f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:56.724681 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7651-1d4e-47fc-ae9d-cc5543018f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:56.726144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7651-1d4e-47fc-ae9d-cc5543018f63 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:56.742785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1149/2292] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:11:56.791746 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:11:56.793513 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:11:56.806842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd03b1d-d6cf-4c5e-8205-b61a1043e66c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:11:56.821560 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:11:56.822713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:11:56.823266 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:11:56.823792 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:11:56.891711 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:11:56.919427 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:11:56.921791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:11:56.939718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1144/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:11:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:00.363382 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717cb28-51b8-43a7-bd21-8c14bd21e282 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:00.364017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717cb28-51b8-43a7-bd21-8c14bd21e282 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:00.364017 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717cb28-51b8-43a7-bd21-8c14bd21e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:00.419217 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b717cb28-51b8-43a7-bd21-8c14bd21e282 None None] MFA Rules not processed for user `706b0570c62e46c791c9fdd7e3caf7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:00.420834 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b717cb28-51b8-43a7-bd21-8c14bd21e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:00.514196 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:00.529197 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1150/2294] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:00.538348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:00.540044 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:00.633792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:00.634476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:00.634809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:00.659299 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] MFA Rules not processed for user `3484bdd7f4764cf3aa9a3a4c97f6efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:00.660932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:00.684493 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571520-a9d1-45ca-ba89-62d166884d74 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:00.692250 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:00.696504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:00.696668 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:00.696942 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:00.709504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:00.765297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1151/2295] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:00.785399 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:00.856264 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:00.858637 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f2b98-25c1-4f61-9e29-5fd57ecdffbc service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:00.884970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1145/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:00.913257 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742db77-5b84-449e-a332-3fd949457e41 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:00.921904 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:00.923202 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:00.923462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:00.923620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] PATH_INFO: `/v3/users/48c568162cab4ae7a9e0ffce92599b27` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:00.925019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c568162cab4ae7a9e0ffce92599b27)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:00.927224 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:01.086500 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c568162cab4ae7a9e0ffce92599b27'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:01.120777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c568162cab4ae7a9e0ffce92599b27'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:01.134511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c568162cab4ae7a9e0ffce92599b27'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:01.135129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c568162cab4ae7a9e0ffce92599b27'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:01.144552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c568162cab4ae7a9e0ffce92599b27'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:01.153018 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1152/2297] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:00 2022] DELETE /identity/v3/users/48c568162cab4ae7a9e0ffce92599b27 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:12:01.157922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc563ea-ccc3-4c11-bf0c-cb972e1317ab None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:01.158813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc563ea-ccc3-4c11-bf0c-cb972e1317ab None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:01.162735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc563ea-ccc3-4c11-bf0c-cb972e1317ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:01.190730 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1dc563ea-ccc3-4c11-bf0c-cb972e1317ab None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:01.192239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1dc563ea-ccc3-4c11-bf0c-cb972e1317ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:01.305194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1146/2298] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:01.323344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:01.340305 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:01.344293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:01.344780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:01.345212 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:01.382777 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] MFA Rules not processed for user `982d09ee8179469d863fe83ca1c6fe72`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:01.385336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:01.391652 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:01.408962 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:01.458078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c75a-7e18-4fa4-9205-865b5294d288 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:01.464941 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:01.466231 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:01.466726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:01.467214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:01.501574 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:01.505595 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:01.521600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1153/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:01.535276 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1147/2300] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:12:01.915411 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:01.918008 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:01.970581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81669978-f612-4a18-af77-e90c49f5ab14 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:01.983092 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:01.984474 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:01.984822 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:01.985161 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] PATH_INFO: `/v3/projects/bbb88962f3344c8c89ac2aa47f11d715` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:01.986461 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb88962f3344c8c89ac2aa47f11d715)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:01.989105 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:02.054916 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb88962f3344c8c89ac2aa47f11d715', 'request_id': 'req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.062796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb88962f3344c8c89ac2aa47f11d715', 'request_id': 'req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.071901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb88962f3344c8c89ac2aa47f11d715', 'request_id': 'req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.092287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] The token cache is being invalidate because project bbb88962f3344c8c89ac2aa47f11d715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:02.092580 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.093262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e17cd41c-e73c-40f7-983c-bc81ed3b7de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.099370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1154/2301] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:01 2022] DELETE /identity/v3/projects/bbb88962f3344c8c89ac2aa47f11d715 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:02.100271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:02.114828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428270-8d42-4ce9-9bd6-3ff747f584b9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:02.207935 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:02.210006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:02.210006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:02.210006 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] PATH_INFO: `/v3/users/901c1ab57324434ca3281a3f6e7f03ea` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:02.211206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=901c1ab57324434ca3281a3f6e7f03ea)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:02.213350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:02.273298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901c1ab57324434ca3281a3f6e7f03ea'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.291787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901c1ab57324434ca3281a3f6e7f03ea'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.300922 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901c1ab57324434ca3281a3f6e7f03ea'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.301538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901c1ab57324434ca3281a3f6e7f03ea'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.302145 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901c1ab57324434ca3281a3f6e7f03ea'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.316724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1148/2302] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:02 2022] DELETE /identity/v3/users/901c1ab57324434ca3281a3f6e7f03ea => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:12:02.384477 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:02.384963 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:02.385452 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:02.411200 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] MFA Rules not processed for user `a5cb7222b9b243a091ab0f1257d4aceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:02.412396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:02.485673 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1155/2303] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:02.658307 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:02.662181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:02.712700 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:02.737629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3a50-223c-4c46-a0ef-0edd860c5c3f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:02.742473 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:02.743403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:02.743762 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:02.744054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] PATH_INFO: `/v3/projects/845f0e6c2265441780266506088e86be` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:02.745290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] RBAC: Authorizing `identity:delete_project(project_id=845f0e6c2265441780266506088e86be)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:02.747215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:02.808843 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845f0e6c2265441780266506088e86be', 'request_id': 'req-e3dc278a-d732-44e2-9893-0884913c935a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.818987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845f0e6c2265441780266506088e86be', 'request_id': 'req-e3dc278a-d732-44e2-9893-0884913c935a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.825937 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845f0e6c2265441780266506088e86be', 'request_id': 'req-e3dc278a-d732-44e2-9893-0884913c935a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.836842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] The token cache is being invalidate because project 845f0e6c2265441780266506088e86be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:02.837154 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.837868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:02.839438 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1149/2304] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:02 2022] DELETE /identity/v3/projects/845f0e6c2265441780266506088e86be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:12:02.843750 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:02.857310 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a16aab-0954-4f3f-a8bb-fd28946affb4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:02.921667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:02.929142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:02.930491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:02.931234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:02.932214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] PATH_INFO: `/v3/users/536abc87b22b4694b02d3d12d6e74aa7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:02.934297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=536abc87b22b4694b02d3d12d6e74aa7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:02.936901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:02.999261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536abc87b22b4694b02d3d12d6e74aa7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.014847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536abc87b22b4694b02d3d12d6e74aa7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.028462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536abc87b22b4694b02d3d12d6e74aa7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.029173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536abc87b22b4694b02d3d12d6e74aa7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.038557 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e8224620-b6f2-4356-aa3d-895451921bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536abc87b22b4694b02d3d12d6e74aa7'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.049140 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1156/2305] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:02 2022] DELETE /identity/v3/users/536abc87b22b4694b02d3d12d6e74aa7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:12:03.354722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:03.356414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:03.391731 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc278a-d732-44e2-9893-0884913c935a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:03.453525 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:03.454321 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:03.454596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:03.454869 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] PATH_INFO: `/v3/projects/bfd7f9a3aff44b6e8781d7477485446c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:03.456160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd7f9a3aff44b6e8781d7477485446c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:03.458109 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:03.511595 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd7f9a3aff44b6e8781d7477485446c', 'request_id': 'req-72a35f8a-2c29-42a7-a384-54907397dcf1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.520284 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd7f9a3aff44b6e8781d7477485446c', 'request_id': 'req-72a35f8a-2c29-42a7-a384-54907397dcf1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.527769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd7f9a3aff44b6e8781d7477485446c', 'request_id': 'req-72a35f8a-2c29-42a7-a384-54907397dcf1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.540532 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:03.545764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] The token cache is being invalidate because project bfd7f9a3aff44b6e8781d7477485446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:03.546424 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.547642 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-72a35f8a-2c29-42a7-a384-54907397dcf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:03.549520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1150/2306] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:03 2022] DELETE /identity/v3/projects/bfd7f9a3aff44b6e8781d7477485446c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:03.555622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:03.556153 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:03.556246 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:03.578278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:03.579504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:03.695722 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1157/2307] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:12:03.696747 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:03.697257 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:03.697798 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:03.725796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:03.727498 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:03.739694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1151/2308] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:12:03.742687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:03.756594 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444c9d-9ba2-42ca-8593-6178da3e85ad None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:03.762606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:03.763416 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:03.763741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:03.764005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:03.764753 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:12:03.765076 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:03.767330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:03.788035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1158/2309] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:12:03.789529 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:03.801428 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51158770-b1ec-4c5a-ab1e-dfd7102ff5a8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:03.813590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:03.814387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:03.814741 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:03.815157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:03.815961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:03.818469 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:03.849483 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1152/2310] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:03 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:12:03.855297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:03.880251 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5698-ad48-4e03-b36b-138120569d7f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:03.980168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:03.980872 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:03.981156 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:03.981432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:03.982729 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:03.984615 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.000388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:04.027973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1159/2311] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:03 2022] POST /identity/v3/users => generated 281 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:12:04.030333 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:04.053630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d52f-0498-42fd-aae5-ae2f9316c5f4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:04.068895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:04.069593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.069883 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.070161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.071105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:04.073391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.091555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:04.101754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1153/2312] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:12:04.104942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261166f-285d-4d94-bd3b-9af74c438c00 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:04.109733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb0efd-a67a-41fc-8a4f-bbfc15f86d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:04.110449 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb0efd-a67a-41fc-8a4f-bbfc15f86d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.110863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb0efd-a67a-41fc-8a4f-bbfc15f86d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.111144 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb0efd-a67a-41fc-8a4f-bbfc15f86d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.111927 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb0efd-a67a-41fc-8a4f-bbfc15f86d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:04.113621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb0efd-a67a-41fc-8a4f-bbfc15f86d41 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.132052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:04.132526 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1160/2313] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:12:04.146332 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa28693-4518-4a3f-b7eb-6451f10f0356 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:04.151165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:04.152144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.152399 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.152678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] PATH_INFO: `/v3/projects/d4bf59d20cd74578b2759d8ff59ebf52/users/d8908941af4e47e19466e4ed7789d8a1/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.168661 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf59d20cd74578b2759d8ff59ebf52, user_id=d8908941af4e47e19466e4ed7789d8a1, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:04.171480 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.188477 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1154/2314] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:04 2022] PUT /identity/v3/projects/d4bf59d20cd74578b2759d8ff59ebf52/users/d8908941af4e47e19466e4ed7789d8a1/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:04.200765 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452aee1-bd26-434d-be64-084ba251298f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.201119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452aee1-bd26-434d-be64-084ba251298f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.201343 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452aee1-bd26-434d-be64-084ba251298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.241726 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c452aee1-bd26-434d-be64-084ba251298f None None] MFA Rules not processed for user `d8908941af4e47e19466e4ed7789d8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:04.242976 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c452aee1-bd26-434d-be64-084ba251298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:04.320165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1161/2315] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:04.352184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:04.354339 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:04.424973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6e94-1112-4ed3-b3a2-bc4266c43abd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:04.431223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bbda-db20-4d51-8749-289d812b96c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:04.432043 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bbda-db20-4d51-8749-289d812b96c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.432389 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bbda-db20-4d51-8749-289d812b96c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.432726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bbda-db20-4d51-8749-289d812b96c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.444014 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476bbda-db20-4d51-8749-289d812b96c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:04.445893 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476bbda-db20-4d51-8749-289d812b96c1 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.456053 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1155/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:04.471006 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452aee1-bd26-434d-be64-084ba251298f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:04.546653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452aee1-bd26-434d-be64-084ba251298f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:04.551802 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:04.552839 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.553129 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.553406 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] PATH_INFO: `/v3/users/d8908941af4e47e19466e4ed7789d8a1` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.554883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8908941af4e47e19466e4ed7789d8a1)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:04.556944 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.608230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8908941af4e47e19466e4ed7789d8a1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:04.622842 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8908941af4e47e19466e4ed7789d8a1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:04.632509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8908941af4e47e19466e4ed7789d8a1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:04.633124 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8908941af4e47e19466e4ed7789d8a1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:04.634755 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:04.643712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8908941af4e47e19466e4ed7789d8a1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:04.650759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1162/2317] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:04 2022] DELETE /identity/v3/users/d8908941af4e47e19466e4ed7789d8a1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:12:04.655466 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.658372 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.658654 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.685324 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:04.686943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:04.762624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1156/2318] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:04.772901 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:04.774491 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:04.840997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbef90-37bb-40a5-961d-e92b0aeada3d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:04.844936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a8ac3-5dc7-4c8f-a92d-bd8cb5c08c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:04.845631 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a8ac3-5dc7-4c8f-a92d-bd8cb5c08c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:04.845951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a8ac3-5dc7-4c8f-a92d-bd8cb5c08c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:04.846227 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a8ac3-5dc7-4c8f-a92d-bd8cb5c08c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:04.857048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a8ac3-5dc7-4c8f-a92d-bd8cb5c08c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:04.858618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a8ac3-5dc7-4c8f-a92d-bd8cb5c08c1d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:04.869899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1163/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:05.166717 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.168658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:05.186309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be027-37f3-4088-850a-3d52cdd7dc81 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.190742 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.191618 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.191933 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.192211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] PATH_INFO: `/v3/projects/d4bf59d20cd74578b2759d8ff59ebf52` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.193715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bf59d20cd74578b2759d8ff59ebf52)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.195673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.241615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:05.254252 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bf59d20cd74578b2759d8ff59ebf52', 'request_id': 'req-e9b786fd-45e4-4c17-b766-642d5351ff6f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:05.262317 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bf59d20cd74578b2759d8ff59ebf52', 'request_id': 'req-e9b786fd-45e4-4c17-b766-642d5351ff6f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:05.268605 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bf59d20cd74578b2759d8ff59ebf52', 'request_id': 'req-e9b786fd-45e4-4c17-b766-642d5351ff6f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:05.279271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] The token cache is being invalidate because project d4bf59d20cd74578b2759d8ff59ebf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:05.279565 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:05.280210 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e9b786fd-45e4-4c17-b766-642d5351ff6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:05.281767 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1157/2320] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:05 2022] DELETE /identity/v3/projects/d4bf59d20cd74578b2759d8ff59ebf52 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:05.286786 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.287078 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.287353 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.304857 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:05.306098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:05.372321 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1164/2321] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:05.380290 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.380580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.380863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.401175 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:05.402404 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:05.412301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1158/2322] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:05.416979 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.427508 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3a9b-d409-45c4-831f-76d373397516 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.433437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.434107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.434386 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.434658 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.435396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:12:05.435701 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.437381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.450423 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1165/2323] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:12:05.455040 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.466387 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eba40-ce1d-432f-b2cd-78e5ed4bd0ce None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.473522 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.474239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.474905 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.475558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.476306 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.479540 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.515297 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1159/2324] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:05.519819 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.530010 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b9407-1357-4f99-b234-170b8d5c79ce admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.598921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.599698 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.599989 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.600348 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.601330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.603742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.626211 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1166/2325] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:05.630693 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.641454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fa307-9283-4a7e-94da-f497bff04f40 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.646186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.646841 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.647123 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.647396 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.648161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.649859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.660391 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1160/2326] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:05.664220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.674968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50707f9c-0f72-4397-906a-0f48703c0613 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.680234 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47fa0e-5f60-49bf-ac76-82ff69d24aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.680898 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47fa0e-5f60-49bf-ac76-82ff69d24aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.681176 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47fa0e-5f60-49bf-ac76-82ff69d24aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.681448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47fa0e-5f60-49bf-ac76-82ff69d24aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.682166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47fa0e-5f60-49bf-ac76-82ff69d24aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.683779 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47fa0e-5f60-49bf-ac76-82ff69d24aa5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.686233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:05.696863 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1167/2327] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:05.701704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.712295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca97929-657d-4c08-ac53-c1506da4e06d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.717080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.718050 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.718385 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.719170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] PATH_INFO: `/v3/projects/5dfb7a1afd954f0491e2f9df15afd9ab/users/a0ee94fbcb4b495a84ec6db0f7c539c0/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.735348 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfb7a1afd954f0491e2f9df15afd9ab, user_id=a0ee94fbcb4b495a84ec6db0f7c539c0, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.738079 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.752946 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1161/2328] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:05 2022] PUT /identity/v3/projects/5dfb7a1afd954f0491e2f9df15afd9ab/users/a0ee94fbcb4b495a84ec6db0f7c539c0/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:05.765435 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.765637 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.765938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.797889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] MFA Rules not processed for user `a0ee94fbcb4b495a84ec6db0f7c539c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:05.799250 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:05.872300 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1168/2329] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:05.876939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.942076 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756350-54e0-4bc8-9bfd-d10f6dbff43d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:05.947126 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:05.947781 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:05.948095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:05.948388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:05.949085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:05.950956 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:05.979322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1162/2330] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:05.983486 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:05.995239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b77e6-3e27-4715-a8dd-8399d6664efd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.057034 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.057713 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.057997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.058271 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.058972 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.060948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.081669 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1169/2331] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:05 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:06.086322 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.097341 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5401b-434c-4259-ae2e-db47a096707a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.103715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.104510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.104787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.105052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.105913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.107794 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.120420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1163/2332] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:06.124814 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.136824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba9f0f-4d31-4360-819d-d213a7c52a08 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.142080 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd79c-861f-4843-bdc7-ac7f1c4971c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.142749 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd79c-861f-4843-bdc7-ac7f1c4971c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.143024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd79c-861f-4843-bdc7-ac7f1c4971c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.143295 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd79c-861f-4843-bdc7-ac7f1c4971c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.144059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd79c-861f-4843-bdc7-ac7f1c4971c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.145653 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd79c-861f-4843-bdc7-ac7f1c4971c1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.155873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1170/2333] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:06.160085 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.170628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cb5f3-23f2-40a3-8402-a8e9c7217123 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.175410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.176617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.176894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.177160 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] PATH_INFO: `/v3/projects/c2278446ee2543b18f5c475acf23088b/users/83e70ffec25f4719bbaaa4931dd26650/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.193174 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2278446ee2543b18f5c475acf23088b, user_id=83e70ffec25f4719bbaaa4931dd26650, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.196035 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.215674 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1164/2334] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:06 2022] PUT /identity/v3/projects/c2278446ee2543b18f5c475acf23088b/users/83e70ffec25f4719bbaaa4931dd26650/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:06.225951 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.226242 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.226962 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.258369 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] MFA Rules not processed for user `83e70ffec25f4719bbaaa4931dd26650`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:06.259582 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:06.317993 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:06.328853 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1171/2335] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:06.333660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.344080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:06.407095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fa23-842b-4f9f-bb19-e0eee6e23720 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.412656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.413414 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.413735 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.414063 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.414795 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.416727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.442374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1165/2336] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:06 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:06.446742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.458769 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb06e4-adf2-4aa0-9a7b-3d75b19ed8fe None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.522704 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.523560 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.523761 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.524073 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.524798 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.526796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.553581 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1172/2337] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:06 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:06.555091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.566713 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140e603-a04b-4ba6-a245-d1fb2b893c5c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.572351 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.573189 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.573584 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.573826 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.574871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.577312 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.590061 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1166/2338] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:06.594558 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.606142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2c2c-be79-4d08-baed-f50a6969b885 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.611185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.612264 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.612547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.612820 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] PATH_INFO: `/v3/projects/5029d1046eb74b798682df73093f04b6/users/55785ee051044af9accaa4a16cd68111/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.629544 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5029d1046eb74b798682df73093f04b6, user_id=55785ee051044af9accaa4a16cd68111, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.632396 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.647502 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1173/2339] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:06 2022] PUT /identity/v3/projects/5029d1046eb74b798682df73093f04b6/users/55785ee051044af9accaa4a16cd68111/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:06.651634 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.661845 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ea9b0-1c0a-43bc-8494-61b807b48fe4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.721766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1b9be-1bb9-46e0-aa25-edd9cfc87823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.722744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1b9be-1bb9-46e0-aa25-edd9cfc87823 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.723025 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1b9be-1bb9-46e0-aa25-edd9cfc87823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.723325 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1b9be-1bb9-46e0-aa25-edd9cfc87823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.724095 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1b9be-1bb9-46e0-aa25-edd9cfc87823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.726039 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1b9be-1bb9-46e0-aa25-edd9cfc87823 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.736628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1167/2340] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:06.741036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.752199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c18de-38e9-4b69-8bcb-a9044ae1985a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.757355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.758233 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.758504 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.758775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] PATH_INFO: `/v3/projects/5029d1046eb74b798682df73093f04b6/users/55785ee051044af9accaa4a16cd68111/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.760792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5029d1046eb74b798682df73093f04b6, user_id=55785ee051044af9accaa4a16cd68111, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:06.763446 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:06.775441 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1174/2341] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:06 2022] PUT /identity/v3/projects/5029d1046eb74b798682df73093f04b6/users/55785ee051044af9accaa4a16cd68111/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:06.785687 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.786066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.786367 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:06.819146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] MFA Rules not processed for user `55785ee051044af9accaa4a16cd68111`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:06.820475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:06.898791 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1168/2342] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:06.910649 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:06.912731 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:06.976821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84559-bbf6-41e7-8bc1-5e4c190ebbfd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:06.980876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:06.981519 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:06.981796 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:06.982066 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:07.045494 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:07.046938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:07.055757 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1175/2343] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:08.596842 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:08.604423 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:08.609436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc0325-4225-47d8-98b9-915a48b888fb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:08.614375 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:08.615147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:08.615433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:08.615707 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:08.678685 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:08.681083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:08.693068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1169/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:09.275285 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:09.279390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:09.285843 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9efac-6f39-4853-877f-ea249f8dc8ad service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:09.290214 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2707b-ba82-43bc-8215-3fdc7439549f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:09.290854 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2707b-ba82-43bc-8215-3fdc7439549f service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:09.291159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2707b-ba82-43bc-8215-3fdc7439549f service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:09.291428 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2707b-ba82-43bc-8215-3fdc7439549f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:09.301278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2707b-ba82-43bc-8215-3fdc7439549f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:09.302693 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2707b-ba82-43bc-8215-3fdc7439549f service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:09.312817 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1176/2345] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:13.521165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:13.587619 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a74c8a-bdc5-472d-9893-f5ebc9c91dbc service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:13.592497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:13.596119 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:13.596436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:13.596724 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] PATH_INFO: `/v3/users/a0ee94fbcb4b495a84ec6db0f7c539c0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:13.598156 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ee94fbcb4b495a84ec6db0f7c539c0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:13.600198 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:13.658350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ee94fbcb4b495a84ec6db0f7c539c0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:13.671676 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ee94fbcb4b495a84ec6db0f7c539c0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:13.680503 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ee94fbcb4b495a84ec6db0f7c539c0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:13.681100 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ee94fbcb4b495a84ec6db0f7c539c0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:13.681715 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ee94fbcb4b495a84ec6db0f7c539c0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:13.694512 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1170/2346] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:13 2022] DELETE /identity/v3/users/a0ee94fbcb4b495a84ec6db0f7c539c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:13.699417 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:13.700035 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:13.700370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:13.729087 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:13.730509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:13.791079 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1177/2347] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:13.801069 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:13.802709 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:13.834701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:13.901162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828f70a-f439-4d98-84ba-9d5ba14aa61b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:13.925223 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:13.927757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:13.929208 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:13.930291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:13.952571 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:13.954130 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:13.967323 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1171/2348] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:14.331046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:14.332635 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:14.349172 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8985a2a-7c23-44b3-be1d-faffe9313939 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:14.356022 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:14.357019 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:14.357368 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:14.357706 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] PATH_INFO: `/v3/projects/5dfb7a1afd954f0491e2f9df15afd9ab` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:14.359116 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfb7a1afd954f0491e2f9df15afd9ab)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:14.361551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:14.442297 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfb7a1afd954f0491e2f9df15afd9ab', 'request_id': 'req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.449905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfb7a1afd954f0491e2f9df15afd9ab', 'request_id': 'req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.491117 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfb7a1afd954f0491e2f9df15afd9ab', 'request_id': 'req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.534026 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] The token cache is being invalidate because project 5dfb7a1afd954f0491e2f9df15afd9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:14.536702 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.539089 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.547412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1178/2349] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:14 2022] DELETE /identity/v3/projects/5dfb7a1afd954f0491e2f9df15afd9ab => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:14.551973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:14.570168 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3719d-2dd0-42f3-9569-9cdb6546a12f service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:14.736413 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:14.738537 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:14.739068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:14.739568 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] PATH_INFO: `/v3/users/83e70ffec25f4719bbaaa4931dd26650` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:14.741941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e70ffec25f4719bbaaa4931dd26650)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:14.744468 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:14.825278 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e70ffec25f4719bbaaa4931dd26650'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.846169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e70ffec25f4719bbaaa4931dd26650'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.864695 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e70ffec25f4719bbaaa4931dd26650'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.865350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e70ffec25f4719bbaaa4931dd26650'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.865991 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e70ffec25f4719bbaaa4931dd26650'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:14.891354 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1172/2350] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:14 2022] DELETE /identity/v3/users/83e70ffec25f4719bbaaa4931dd26650 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:15.972365 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:15.973932 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:15.995515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af333a-3aaf-4fce-8b52-37cb5cf0d2ab admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:16.156099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:16.157075 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:16.157453 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:16.157838 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] PATH_INFO: `/v3/projects/c2278446ee2543b18f5c475acf23088b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:16.159215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2278446ee2543b18f5c475acf23088b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:16.161424 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:16.188805 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:16.248855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2278446ee2543b18f5c475acf23088b', 'request_id': 'req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.257489 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2278446ee2543b18f5c475acf23088b', 'request_id': 'req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.265458 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2278446ee2543b18f5c475acf23088b', 'request_id': 'req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.286551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] The token cache is being invalidate because project c2278446ee2543b18f5c475acf23088b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:16.286881 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.288174 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.292624 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1179/2351] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:15 2022] DELETE /identity/v3/projects/c2278446ee2543b18f5c475acf23088b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:16.303738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:16.305293 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:16.320988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c87f8c-cfbf-4993-9bbc-f62c41445940 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:16.380800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:16.405774 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:16.406925 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:16.407196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:16.407535 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] PATH_INFO: `/v3/users/55785ee051044af9accaa4a16cd68111` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:16.411868 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55785ee051044af9accaa4a16cd68111)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:16.413904 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:16.472134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55785ee051044af9accaa4a16cd68111'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.493158 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55785ee051044af9accaa4a16cd68111'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.507552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55785ee051044af9accaa4a16cd68111'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.508630 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55785ee051044af9accaa4a16cd68111'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.509557 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59f88980-ee1f-4b28-9233-275fc8ba26d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55785ee051044af9accaa4a16cd68111'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:16.530450 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1173/2352] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:16 2022] DELETE /identity/v3/users/55785ee051044af9accaa4a16cd68111 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:17.422889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:17.425232 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:17.440335 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3799-3f2e-42c3-be56-3b6c2fc18b8d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:17.509821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:17.510733 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.510988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.511265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] PATH_INFO: `/v3/projects/5029d1046eb74b798682df73093f04b6` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.512498 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5029d1046eb74b798682df73093f04b6)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:17.514440 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:17.565391 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5029d1046eb74b798682df73093f04b6', 'request_id': 'req-f551654c-396e-4d55-8d11-b62f20e5c2c6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:17.571937 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5029d1046eb74b798682df73093f04b6', 'request_id': 'req-f551654c-396e-4d55-8d11-b62f20e5c2c6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:17.577921 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5029d1046eb74b798682df73093f04b6', 'request_id': 'req-f551654c-396e-4d55-8d11-b62f20e5c2c6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:17.592601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] The token cache is being invalidate because project 5029d1046eb74b798682df73093f04b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:17.593204 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:17.593795 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f551654c-396e-4d55-8d11-b62f20e5c2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:17.600024 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1180/2353] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:17 2022] DELETE /identity/v3/projects/5029d1046eb74b798682df73093f04b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:17.603734 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.604301 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.605456 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.627222 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:17.628497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:17.722194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1174/2354] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:12:17.723889 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.724175 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.724451 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.747606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:17.748532 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:17.761528 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1181/2355] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:17.767309 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:17.778485 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3de09d-cbe2-49c4-b5d2-5f4e7584e09f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:17.783539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:17.784280 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.784580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.784917 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.785737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:12:17.786046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:17.787780 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:17.801932 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1175/2356] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 07:12:17.806638 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:17.817061 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d9ea-ea6b-4bdb-b397-c01c8892bfef None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:17.822027 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:17.822687 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.822975 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.823291 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.824046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:17.826020 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:17.853102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1182/2357] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:17 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:17.858018 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:17.870538 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56176d3-938d-4a8a-af10-dec53716c11e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:17.920973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:17.933494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:17.934558 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.934840 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.935112 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.935836 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:17.937832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:17.965199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1176/2358] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:17 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 07:12:17.969177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:17.979269 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:17.987015 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a257c02-c732-417c-a3fb-fec1e5897d3a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:17.997142 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:17.997948 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:17.998303 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:17.998651 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:17.999511 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:18.001778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:18.018778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1183/2359] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:18.022176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:18.032859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4f1e-5537-4e42-80c7-ab7115e7a456 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:18.037507 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60941d-8f49-45a8-97da-d928e93b13de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:18.038208 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60941d-8f49-45a8-97da-d928e93b13de admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:18.038497 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60941d-8f49-45a8-97da-d928e93b13de admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:18.038770 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60941d-8f49-45a8-97da-d928e93b13de admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:18.039549 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60941d-8f49-45a8-97da-d928e93b13de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:18.041199 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60941d-8f49-45a8-97da-d928e93b13de admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:18.059799 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1177/2360] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:18.064738 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:18.075871 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d267-6de5-4d2c-9ede-cea1d3a5bab9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:18.080724 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:18.081618 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:18.081896 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:18.082170 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] PATH_INFO: `/v3/projects/d87a47ecef1643d5ba4abd15a793315a/users/67dfe09e47b549b0841dec38f9f3e0f9/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:18.098381 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87a47ecef1643d5ba4abd15a793315a, user_id=67dfe09e47b549b0841dec38f9f3e0f9, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:18.101137 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:18.119279 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1184/2361] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:18 2022] PUT /identity/v3/projects/d87a47ecef1643d5ba4abd15a793315a/users/67dfe09e47b549b0841dec38f9f3e0f9/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 07:12:18.130146 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17075f2-7a2d-42f7-9d41-a2901e402d47 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:18.130434 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17075f2-7a2d-42f7-9d41-a2901e402d47 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:18.130704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17075f2-7a2d-42f7-9d41-a2901e402d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:18.159023 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f17075f2-7a2d-42f7-9d41-a2901e402d47 None None] MFA Rules not processed for user `67dfe09e47b549b0841dec38f9f3e0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:18.160251 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f17075f2-7a2d-42f7-9d41-a2901e402d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:18.255734 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1178/2362] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:18.267490 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:18.274734 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:18.324742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad219ee-b132-470f-a747-80185c96afb6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:18.328828 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:18.329485 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:18.329766 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:18.330036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:18.342969 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:18.345312 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:18.358775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1185/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:25.952865 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b001904-368a-455c-bd3e-ae21f297701f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:25.953499 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b001904-368a-455c-bd3e-ae21f297701f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:25.958978 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b001904-368a-455c-bd3e-ae21f297701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:25.975131 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8b001904-368a-455c-bd3e-ae21f297701f None None] MFA Rules not processed for user `555360abbf81465795c4900b1a38b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:25.976701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8b001904-368a-455c-bd3e-ae21f297701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:26.065871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1179/2364] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:26.600150 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:26.668476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9d6fb-3c9d-4056-a5cd-edd8231cf882 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:26.673360 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:26.674499 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:26.674784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:26.675059 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] PATH_INFO: `/v3/users/67dfe09e47b549b0841dec38f9f3e0f9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:26.676325 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67dfe09e47b549b0841dec38f9f3e0f9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:26.678379 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:26.747981 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67dfe09e47b549b0841dec38f9f3e0f9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:26.764832 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67dfe09e47b549b0841dec38f9f3e0f9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:26.779278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67dfe09e47b549b0841dec38f9f3e0f9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:26.780785 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67dfe09e47b549b0841dec38f9f3e0f9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:26.785005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:26.799168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67dfe09e47b549b0841dec38f9f3e0f9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:26.831189 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1186/2365] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:26 2022] DELETE /identity/v3/users/67dfe09e47b549b0841dec38f9f3e0f9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:26.836211 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:26.836506 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:26.836819 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:26.873012 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:26.874814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:26.996609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1180/2366] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:27.004307 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:27.005743 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:27.168215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82fb7c-5c22-4c52-bae2-1d08abf48015 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:27.186160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:27.187242 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:27.187572 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:27.187878 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:27.206737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:27.208605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:27.253220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1187/2367] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:27.629832 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:27.631567 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:27.644761 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:27.650133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42bfa3-7a02-487e-9ad8-0e5c2be93f5f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:27.662909 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:27.665590 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:27.666778 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:27.667236 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] PATH_INFO: `/v3/projects/d87a47ecef1643d5ba4abd15a793315a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:27.672091 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87a47ecef1643d5ba4abd15a793315a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:27.674852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:27.746237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87a47ecef1643d5ba4abd15a793315a', 'request_id': 'req-a22253e3-553b-49b6-b558-5b1052571d2c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:27.755237 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87a47ecef1643d5ba4abd15a793315a', 'request_id': 'req-a22253e3-553b-49b6-b558-5b1052571d2c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:27.762169 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87a47ecef1643d5ba4abd15a793315a', 'request_id': 'req-a22253e3-553b-49b6-b558-5b1052571d2c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:27.775814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] The token cache is being invalidate because project d87a47ecef1643d5ba4abd15a793315a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:27.776704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:27.777460 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a22253e3-553b-49b6-b558-5b1052571d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:27.779230 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1181/2368] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:27 2022] DELETE /identity/v3/projects/d87a47ecef1643d5ba4abd15a793315a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:37.242562 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=30 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:37.772580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:38.111005 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:38.112646 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:38.126470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d948ce-60c6-4abf-ab9b-93a7361c548d service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:38.185866 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:38.186759 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:38.187040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:38.187316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] PATH_INFO: `/v3/users/a52806b021904e74add823c048c3a9b1` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:38.188583 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52806b021904e74add823c048c3a9b1)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:38.190555 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:38.253220 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52806b021904e74add823c048c3a9b1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:38.266777 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52806b021904e74add823c048c3a9b1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:38.276054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52806b021904e74add823c048c3a9b1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:38.276764 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52806b021904e74add823c048c3a9b1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:38.284107 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52806b021904e74add823c048c3a9b1'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:38.290344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1188/2369] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:12:38 2022] DELETE /identity/v3/users/a52806b021904e74add823c048c3a9b1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:38.295270 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:38.295626 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:38.295997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:38.376081 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:38.377436 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:38.483793 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1182/2370] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:38.493821 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:38.495230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:38.588062 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:38.600098 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74689771-83d8-44be-af59-cdb24caa2462 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:38.604327 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224ee3e-0160-452e-ad04-f5393029544f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:38.604973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ee3e-0160-452e-ad04-f5393029544f service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:38.605247 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ee3e-0160-452e-ad04-f5393029544f service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:38.605513 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ee3e-0160-452e-ad04-f5393029544f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:38.614585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224ee3e-0160-452e-ad04-f5393029544f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:38.616042 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224ee3e-0160-452e-ad04-f5393029544f service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:38.625924 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1189/2371] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:39.079764 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.081308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:39.093941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e58d-a997-4737-8c63-a55c08b59435 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.100291 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.101287 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.101629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.101973 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] PATH_INFO: `/v3/projects/5781e2ee0c3b45488de7935539b317ed` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.103259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5781e2ee0c3b45488de7935539b317ed)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.106089 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.154492 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5781e2ee0c3b45488de7935539b317ed', 'request_id': 'req-b5c56f99-7abd-4e25-8130-17bcd1bcac98'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:39.161790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5781e2ee0c3b45488de7935539b317ed', 'request_id': 'req-b5c56f99-7abd-4e25-8130-17bcd1bcac98'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:39.168486 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5781e2ee0c3b45488de7935539b317ed', 'request_id': 'req-b5c56f99-7abd-4e25-8130-17bcd1bcac98'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:39.178765 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] The token cache is being invalidate because project 5781e2ee0c3b45488de7935539b317ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:12:39.179047 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:39.179696 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b5c56f99-7abd-4e25-8130-17bcd1bcac98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:12:39.181437 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1183/2372] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:12:39 2022] DELETE /identity/v3/projects/5781e2ee0c3b45488de7935539b317ed => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:39.186515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.186809 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.187099 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.226048 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:39.227261 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:39.300570 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1190/2373] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:39.310271 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.310555 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.310830 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.330285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:39.331482 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:39.342448 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1184/2374] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:39.346942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.357672 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381123e-4830-4730-8f20-9a1211888b03 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.363193 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.363875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.364181 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.364464 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.365205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 07:12:39.365515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.367149 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.379797 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1191/2375] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jun 24 07:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 07:12:39.384249 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.394020 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f460fc-6c29-4e30-9b63-086ff43557ff None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.399987 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.400639 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.400915 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.401186 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.401866 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.403771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.408080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:39.434302 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1185/2376] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:39 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:39.438442 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.449314 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b131c5-9c35-4964-84ff-f070717e18ba admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.510661 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.511334 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.511613 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.511897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.512608 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.514509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.537602 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1192/2377] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:39 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:39.541970 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.554403 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a5c0-a9f1-41f4-aa4c-c661f23f1e10 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.559208 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.559859 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.560147 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.560420 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.561229 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.562858 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.573407 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1186/2378] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 07:12:39.577255 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.587791 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea99f6-abfd-44db-8f63-f12da473f134 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.592910 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a294f07-ebbf-4825-9ee9-d6bd8dc83fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.594081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a294f07-ebbf-4825-9ee9-d6bd8dc83fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.594081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a294f07-ebbf-4825-9ee9-d6bd8dc83fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.594081 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a294f07-ebbf-4825-9ee9-d6bd8dc83fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.594873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a294f07-ebbf-4825-9ee9-d6bd8dc83fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.596564 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a294f07-ebbf-4825-9ee9-d6bd8dc83fe5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.607388 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1193/2379] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:39.611737 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.622133 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5ee3f-6e13-4f02-95b6-7bc080265772 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.626943 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.627880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.628976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.628976 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] PATH_INFO: `/v3/projects/6085cfab9655458683555124667d1781/users/ed0d332306514d3ea785465e8832e1ab/roles/658e15b437f34e58aaffdfdd2f52944e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.646165 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6085cfab9655458683555124667d1781, user_id=ed0d332306514d3ea785465e8832e1ab, role_id=658e15b437f34e58aaffdfdd2f52944e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.648997 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.665239 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1187/2380] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:39 2022] PUT /identity/v3/projects/6085cfab9655458683555124667d1781/users/ed0d332306514d3ea785465e8832e1ab/roles/658e15b437f34e58aaffdfdd2f52944e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:39.670620 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5f652-f3a7-467c-a426-9966d2e041a5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.670934 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5f652-f3a7-467c-a426-9966d2e041a5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.671215 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5f652-f3a7-467c-a426-9966d2e041a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.689177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6ae5f652-f3a7-467c-a426-9966d2e041a5 None None] MFA Rules not processed for user `f51e7a8fc6624717bbfc71dfc519fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:39.690311 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6ae5f652-f3a7-467c-a426-9966d2e041a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:39.725109 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:39.757742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1194/2381] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:39.768673 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:39.770666 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:39.833054 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3045-6116-4965-9947-53c2f621f81e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:39.837441 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:39.838101 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:39.838378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:39.838694 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:39.848259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:39.849692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:39.859524 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1188/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:44.516804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:44.517287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:44.517547 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:44.576894 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] MFA Rules not processed for user `ed0d332306514d3ea785465e8832e1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:44.578277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:44.682060 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1195/2383] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:44.683660 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:44.700489 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aeb2e-4caa-4c2f-95b6-3b1b07089c13 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:44.705825 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:44.706504 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:44.706875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:44.707259 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:44.707838 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:44.709790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:44.742299 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1189/2384] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jun 24 07:12:44 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:44.743431 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:44.760225 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28d4d4-aa50-4cc9-9ecb-ac9fdf01ecca None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:44.846185 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:44.846883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:44.847166 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:44.847438 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:44.848199 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:44.850218 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:44.882787 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1196/2385] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jun 24 07:12:44 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 07:12:44.886740 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:44.898462 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafceb9-0068-4982-ac9a-9f1ddcffc44f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:44.918718 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:44.919721 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:44.920244 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:44.920926 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:44.923585 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:44.928285 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:44.955889 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1190/2386] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:44.957895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:44.968752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa44405-ec75-486e-b1ce-1654456b67bf admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:44.975330 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:44.976377 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:44.976720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:44.977055 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] PATH_INFO: `/v3/projects/67cba54c90874bf0acf9b9fececb2d14/users/0c142f520b744110908e23c136e4afc2/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:45.007895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cba54c90874bf0acf9b9fececb2d14, user_id=0c142f520b744110908e23c136e4afc2, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:45.010847 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:45.035945 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1197/2387] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:44 2022] PUT /identity/v3/projects/67cba54c90874bf0acf9b9fececb2d14/users/0c142f520b744110908e23c136e4afc2/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:45.039934 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:45.055651 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037314-3691-4332-af0a-c0eafb061902 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:45.128985 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95757d-cdfc-43af-9f8d-8830517b5405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:45.129941 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95757d-cdfc-43af-9f8d-8830517b5405 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:45.130494 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95757d-cdfc-43af-9f8d-8830517b5405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:45.130975 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95757d-cdfc-43af-9f8d-8830517b5405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:45.132440 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95757d-cdfc-43af-9f8d-8830517b5405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:45.134388 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95757d-cdfc-43af-9f8d-8830517b5405 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:45.145736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1191/2388] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jun 24 07:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 07:12:45.149959 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:45.161187 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9971250-5c0c-46ca-86d5-5aea8563b373 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:45.166362 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:45.167286 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:45.167563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:45.167835 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] PATH_INFO: `/v3/projects/67cba54c90874bf0acf9b9fececb2d14/users/0c142f520b744110908e23c136e4afc2/roles/c55009d9dd08464ebde7f96db3459dea` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:45.169978 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cba54c90874bf0acf9b9fececb2d14, user_id=0c142f520b744110908e23c136e4afc2, role_id=c55009d9dd08464ebde7f96db3459dea)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:45.173131 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:45.187912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1198/2389] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jun 24 07:12:45 2022] PUT /identity/v3/projects/67cba54c90874bf0acf9b9fececb2d14/users/0c142f520b744110908e23c136e4afc2/roles/c55009d9dd08464ebde7f96db3459dea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:12:51.013833 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69da1c-957e-4b4d-be3c-25e8ad41be73 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:51.014409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69da1c-957e-4b4d-be3c-25e8ad41be73 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:51.014409 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69da1c-957e-4b4d-be3c-25e8ad41be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:51.122961 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-af69da1c-957e-4b4d-be3c-25e8ad41be73 None None] MFA Rules not processed for user `0c142f520b744110908e23c136e4afc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:51.124255 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af69da1c-957e-4b4d-be3c-25e8ad41be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:51.138298 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:51.231451 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1192/2390] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:12:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:51.244906 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:51.246895 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:51.272824 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:12:51.315216 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb6066-015a-4a4f-a246-07cddc0a3271 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:51.319475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:51.319641 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:51.319912 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:51.320168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:51.398238 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:51.400084 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:51.411344 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1199/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:12:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:12:51.528597 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366524-1449-4168-b003-c92718905eb5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:51.530045 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366524-1449-4168-b003-c92718905eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:51.530335 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366524-1449-4168-b003-c92718905eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:51.600678 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-af366524-1449-4168-b003-c92718905eb5 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:12:51.602218 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af366524-1449-4168-b003-c92718905eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:51.670990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1193/2392] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:12:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:12:51.718987 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:12:51.725266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:12:51.809403 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f5556-3564-4a1e-a188-28b10fcc0e14 service glance] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:12:51.816551 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:12:51.817632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:12:51.818266 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:12:51.818384 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:12:51.829430 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:12:51.831194 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:12:51.847146 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1200/2393] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:13:01.662796 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=55 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:01.841475 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=73 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:02.349875 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18379980-763d-48da-a464-625dda2b6b58 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:02.350233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18379980-763d-48da-a464-625dda2b6b58 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:02.350576 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18379980-763d-48da-a464-625dda2b6b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:02.369610 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-18379980-763d-48da-a464-625dda2b6b58 None None] MFA Rules not processed for user `ed0d332306514d3ea785465e8832e1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:02.370871 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-18379980-763d-48da-a464-625dda2b6b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:02.379024 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1194/2394] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:13:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:03.536120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:03.537606 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:03.663954 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e68197-ff9b-4d73-9c93-8c5cbed3f678 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:03.668985 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6637a4d8b7104d158d4d9952cc2a5216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:03.669650 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:03.669933 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:03.670209 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:03.672728 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:03.686426 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:03.688248 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:03.703133 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1201/2395] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:13:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:13:04.263807 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0870-8c29-4d14-ad27-6b36829f645d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:04.264342 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0870-8c29-4d14-ad27-6b36829f645d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:04.264446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0870-8c29-4d14-ad27-6b36829f645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:04.282421 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a6fc0870-8c29-4d14-ad27-6b36829f645d None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:04.283629 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a6fc0870-8c29-4d14-ad27-6b36829f645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:04.298769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1195/2396] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:13:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:04.311230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:04.323482 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680539-64b2-4410-ad43-aff1bf0d453c service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:04.328897 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:04.329515 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:04.329816 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:04.330052 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:04.340444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:04.341973 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:04.352254 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1202/2397] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:13:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 07:13:06.150521 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f79c3-d14d-453c-bf5d-61fb7d83a2c7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:06.151502 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f79c3-d14d-453c-bf5d-61fb7d83a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:06.151877 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f79c3-d14d-453c-bf5d-61fb7d83a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:06.173295 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c49f79c3-d14d-453c-bf5d-61fb7d83a2c7 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:06.174754 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c49f79c3-d14d-453c-bf5d-61fb7d83a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:06.184214 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1196/2398] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:13:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:06.208262 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:06.218856 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e078-381b-4647-9467-5a09209453e2 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:06.225778 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:06.226472 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:06.226804 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:06.227333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:06.239480 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:06.242173 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:06.256192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1203/2399] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:13:16.166692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=12 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:16.251617 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=53 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:22.787242 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:22.787814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:22.787814 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:22.807445 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:22.808698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:22.817727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1197/2400] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jun 24 07:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:22.834159 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:22.845935 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a53b-94e1-46ef-85e1-ebb31cc2f19c service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:22.852479 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:22.853135 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:22.853413 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:22.853685 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:22.862780 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:22.864437 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:22.873122 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1204/2401] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:13:23.292032 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:23.348378 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee017565-6d8e-44ab-83c6-75a2b1f8a005 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:23.351939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:23.352686 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:23.353114 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:23.353393 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:23.355527 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:23.430316 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:23.431903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:23.444455 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1198/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:13:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:13:25.146138 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:25.147657 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:25.233346 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ac9a3-817a-464b-a21a-1990a5aefc60 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:25.238505 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:25.239470 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:25.239807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:25.240036 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] PATH_INFO: `/v3/users/982d09ee8179469d863fe83ca1c6fe72` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:25.241277 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982d09ee8179469d863fe83ca1c6fe72)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:25.244333 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:25.299468 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982d09ee8179469d863fe83ca1c6fe72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.316654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982d09ee8179469d863fe83ca1c6fe72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.325968 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982d09ee8179469d863fe83ca1c6fe72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.326587 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982d09ee8179469d863fe83ca1c6fe72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.334794 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-35569312-617e-403f-8c3f-659e1c2f5cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982d09ee8179469d863fe83ca1c6fe72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.347958 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1205/2403] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jun 24 07:13:25 2022] DELETE /identity/v3/users/982d09ee8179469d863fe83ca1c6fe72 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:13:25.538736 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:25.552536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e96b04-5fc4-4569-bbee-6bcb6329b1dd service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:25.623197 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e7a8fc6624717bbfc71dfc519fca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '380a960ee385491dbc55afab2693ac72', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:25.624751 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:25.625187 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:25.625475 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] PATH_INFO: `/v3/projects/035e2cc7025240a899a22bb9748ae7fc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:25.626726 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035e2cc7025240a899a22bb9748ae7fc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:25.629207 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:25.687539 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:25.690766 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035e2cc7025240a899a22bb9748ae7fc', 'request_id': 'req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.709732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035e2cc7025240a899a22bb9748ae7fc', 'request_id': 'req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.724757 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035e2cc7025240a899a22bb9748ae7fc', 'request_id': 'req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.741347 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] The token cache is being invalidate because project 035e2cc7025240a899a22bb9748ae7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 07:13:25.741784 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.743256 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ac6366a5-2ce1-4afe-ba73-7fd5a586c434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 07:13:25.745300 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1199/2404] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jun 24 07:13:25 2022] DELETE /identity/v3/projects/035e2cc7025240a899a22bb9748ae7fc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 07:13:35.341870 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:35.736921 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:36.383476 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:36.383938 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:36.384067 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:36.402860 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] MFA Rules not processed for user `a39ac3a839ba470181b0466580fb5065`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:36.404119 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:36.464164 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1206/2405] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jun 24 07:13:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:40.372202 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:40.372679 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:40.372771 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:40.425376 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:40.426732 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:40.499265 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1200/2406] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:13:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 07:13:40.511792 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:40.513524 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:40.608552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c709b-fd3b-4e74-84fc-c749a7cc14dd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:40.613432 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e8f8a-f27b-4c6e-9af8-baa240dfb2db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:40.614091 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e8f8a-f27b-4c6e-9af8-baa240dfb2db service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:40.614373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e8f8a-f27b-4c6e-9af8-baa240dfb2db service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:40.614648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e8f8a-f27b-4c6e-9af8-baa240dfb2db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:40.623037 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e8f8a-f27b-4c6e-9af8-baa240dfb2db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:40.624720 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e8f8a-f27b-4c6e-9af8-baa240dfb2db service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:40.632837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1207/2407] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:13:47.343790 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:47.345628 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:47.457227 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3be1e3-2a97-45b8-b5fe-bdd14270a8d8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:47.462184 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:47.463191 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:47.463488 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:47.463900 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:47.466219 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:47.565046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:47.568269 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc219887-e389-4427-9c55-fbca11cbc5f9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:47.588068 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1201/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:13:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:13:50.630457 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=66 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:54.349859 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8758f-e033-4a58-a852-95c015052371 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.350518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8758f-e033-4a58-a852-95c015052371 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.350518 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8758f-e033-4a58-a852-95c015052371 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.351807 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1208/2409] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:13:54.357749 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7035f-f867-4594-a0d5-989da2126d44 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.358310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7035f-f867-4594-a0d5-989da2126d44 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.358415 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7035f-f867-4594-a0d5-989da2126d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.393120 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:13:54.419817 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-81b7035f-f867-4594-a0d5-989da2126d44 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:54.421194 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-81b7035f-f867-4594-a0d5-989da2126d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:54.503531 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1202/2410] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:13:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:54.515694 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8758f-e033-4a58-a852-95c015052371 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:54.517533 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-03d8758f-e033-4a58-a852-95c015052371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:54.610182 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8758f-e033-4a58-a852-95c015052371 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:54.614205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe266b-5982-4566-a457-73b14b2a109f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd928c6bee9f744c082c98811fcb35629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:54.614875 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe266b-5982-4566-a457-73b14b2a109f service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.615171 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe266b-5982-4566-a457-73b14b2a109f service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.615448 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe266b-5982-4566-a457-73b14b2a109f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.626942 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe266b-5982-4566-a457-73b14b2a109f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:54.628503 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe266b-5982-4566-a457-73b14b2a109f service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:54.640775 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1209/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:13:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:13:54.725511 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819aff3-70e0-4630-a975-a070401464d2 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.725894 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819aff3-70e0-4630-a975-a070401464d2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.726232 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819aff3-70e0-4630-a975-a070401464d2 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.727811 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1203/2412] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:13:54.734165 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d80-1084-4941-8a79-e3db0d1c99cb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.734462 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d80-1084-4941-8a79-e3db0d1c99cb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.734752 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608d80-1084-4941-8a79-e3db0d1c99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.754205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5f608d80-1084-4941-8a79-e3db0d1c99cb None None] MFA Rules not processed for user `d6e8bab40c4b4f029d9ac7600d756797`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:54.755444 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5f608d80-1084-4941-8a79-e3db0d1c99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:54.762047 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1210/2413] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:13:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:54.774080 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819aff3-70e0-4630-a975-a070401464d2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:54.785433 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819aff3-70e0-4630-a975-a070401464d2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:54.789057 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d19f9-d808-4c30-9293-faff4ffe473b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:54.789772 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d19f9-d808-4c30-9293-faff4ffe473b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.790056 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d19f9-d808-4c30-9293-faff4ffe473b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.790330 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d19f9-d808-4c30-9293-faff4ffe473b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.801608 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d19f9-d808-4c30-9293-faff4ffe473b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:54.803161 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d19f9-d808-4c30-9293-faff4ffe473b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:54.811863 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1204/2414] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:13:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 07:13:54.896434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c7c3-b29f-4315-ae82-14cd173f76de None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.896626 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c7c3-b29f-4315-ae82-14cd173f76de None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.896905 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c7c3-b29f-4315-ae82-14cd173f76de None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.898412 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1211/2415] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jun 24 07:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 07:13:54.904046 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf77010-458f-4139-a7b3-e747599825e6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.904410 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf77010-458f-4139-a7b3-e747599825e6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.904828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf77010-458f-4139-a7b3-e747599825e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.924224 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-abf77010-458f-4139-a7b3-e747599825e6 None None] MFA Rules not processed for user `f8f4b69c63f444d1997b3426cdf1eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:13:54.926163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-abf77010-458f-4139-a7b3-e747599825e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:54.937988 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1205/2416] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jun 24 07:13:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:13:54.950102 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88c7c3-b29f-4315-ae82-14cd173f76de None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:13:54.952203 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7b88c7c3-b29f-4315-ae82-14cd173f76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:13:54.973732 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88c7c3-b29f-4315-ae82-14cd173f76de None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:13:54.979556 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:13:54.980256 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:13:54.980542 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:13:54.980936 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:13:54.993340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:13:54.994654 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:13:55.007205 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1212/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:13:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:14:04.917727 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=49 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:14:05.002157 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=44 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:14:46.811005 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:14:46.811656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:14:46.811656 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:14:46.835897 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:14:46.837180 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:14:46.849636 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1206/2418] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jun 24 07:14:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:14:46.893601 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:14:46.911290 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821cb1-1051-4f08-a58a-6ee494c69414 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:14:46.918684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:14:46.919322 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:14:46.919600 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:14:46.919877 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:14:46.927899 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:14:46.929481 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:14:46.937825 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1213/2419] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:14:48.572310 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:14:48.583331 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec4d7b-7cb7-4a49-8151-58b299afa707 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:14:48.590099 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:14:48.590880 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:14:48.591163 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:14:48.591467 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:14:48.593624 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:14:48.608350 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:14:48.609828 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:14:48.622392 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1207/2420] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:14:51.764370 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:14:51.774373 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f078-79de-448d-8784-48bfe9511254 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:14:51.778585 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:14:51.779275 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:14:51.779565 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:14:51.779837 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:14:51.783317 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:14:51.796179 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:14:51.797612 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:14:51.809997 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1214/2421] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:14:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:14:57.444705 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:14:57.446374 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:14:57.461034 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ece767-3a8d-4704-a1cd-6c9ed6c3a53c service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:14:57.468658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:14:57.469283 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:14:57.469536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:14:57.469810 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:14:57.472052 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:14:57.533903 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:14:57.535496 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1305d-a063-4df5-ab3c-a01d41a1b6e4 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:14:57.544510 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1208/2422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:14:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:15:01.738265 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:15:01.740855 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:01.827364 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cdea-5f00-4768-9768-a0c142b736b7 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:15:01.831096 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:15:01.831742 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:15:01.832046 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:15:01.832316 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:15:01.834054 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:01.892790 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:15:01.894243 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:15:01.903355 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1215/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:15:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:15:07.540658 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=37 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:15:08.582596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:15:08.583170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:15:08.583170 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:15:08.601596 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] MFA Rules not processed for user `893b4543600e4327953f70952a03802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 07:15:08.602815 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:08.611083 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1209/2424] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jun 24 07:15:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 07:15:08.623826 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:15:08.638667 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc35d6-55ce-48b3-abf2-bc46a28b8957 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:15:08.645419 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f528585e29824f548ba7b76848bd0f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:15:08.647198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:15:08.647198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:15:08.647198 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:15:08.657148 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:15:08.658876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:15:08.668495 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1216/2425] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jun 24 07:15:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 07:15:18.596617 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:15:18.664549 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=75 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:15:44.817215 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:15:44.827710 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bad09b-e9ee-4295-b655-92e270559fcb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:15:44.832446 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:15:44.833105 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:15:44.833431 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:15:44.833698 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:15:44.835787 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:44.845852 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:15:44.847303 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:15:44.855744 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1210/2426] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:15:46.769210 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:15:46.771219 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:46.789192 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f1fa-eafa-45a1-bebe-28a04d608d8f service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:15:46.804737 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:15:46.805754 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:15:46.806177 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:15:46.806605 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:15:46.808622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:46.823340 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:15:46.825492 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:15:46.838434 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1217/2427] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:15:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:15:50.508701 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:15:50.524395 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb031bc-3207-44af-af26-833ddaddd47d service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:15:50.530520 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:15:50.531253 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:15:50.531593 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:15:50.531967 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:15:50.533895 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:15:50.552206 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:15:50.553800 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:15:50.564226 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1211/2428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:15:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:15:56.838848 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=6 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:16:00.560098 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=12 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:16:37.801812 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:16:37.814230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863549c-6bef-4afd-a3a2-bf909741eb51 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:16:37.822390 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:16:37.823040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:16:37.823352 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:16:37.823621 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:16:37.825552 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:16:37.889160 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:16:37.890680 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:16:37.899741 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1218/2429] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:16:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:16:45.886563 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:16:45.888181 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:16:45.900305 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2621cf-d82a-4727-bd61-5b3aa013eba6 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:16:45.905088 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:16:45.905813 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:16:45.906722 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:16:45.907008 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:16:45.908908 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:16:45.920536 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:16:45.921979 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:16:45.931196 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1212/2430] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:16:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:16:47.895883 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=28 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:16:55.927157 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:17:47.192909 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:17:47.205563 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e1c3-d5ed-4b52-85f0-b9f805f36779 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:17:47.212684 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8f4b69c63f444d1997b3426cdf1eb00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:17:47.213531 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:17:47.213815 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:17:47.214088 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:17:47.216120 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:17:47.283456 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:17:47.286168 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:17:47.298648 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1219/2431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:17:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:17:57.294040 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=28 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:18:07.405474 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:18:07.407015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:18:07.478425 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e2a4-d671-4a94-b0a9-4c102fc4bcc3 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:18:07.484849 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6637a4d8b7104d158d4d9952cc2a5216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:18:07.485769 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:18:07.486134 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:18:07.486491 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:18:07.489429 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:18:07.507144 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:18:07.509580 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:18:07.519939 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1213/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:18:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:18:17.515501 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=32 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:18:46.047273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:18:46.057676 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbeee-1b4e-45db-9d24-9e113aa3541d service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:18:46.062283 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:18:46.062988 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:18:46.063270 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:18:46.063530 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:18:46.065712 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:18:46.131831 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:18:46.133389 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:18:46.143014 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1220/2433] 10.222.0.27 () {60 vars in 1396 bytes} [Fri Jun 24 07:18:46 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:18:56.138632 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=28 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:20:46.329947 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:20:46.340015 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506def-4035-4d24-9dbe-901daa9496d0 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:20:46.344066 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:20:46.344704 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:20:46.344984 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:20:46.345255 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:20:46.356183 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:20:46.357990 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:20:46.369996 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1214/2434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:20:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:20:46.416230 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:20:46.423634 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa742f-089d-4ae4-8842-2b54496d47c9 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:20:46.427287 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:20:46.427960 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:20:46.428239 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:20:46.428509 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:20:46.436939 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:20:46.438393 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:20:46.466273 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1221/2435] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:20:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:20:56.364643 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:20:56.463873 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=13 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:21:07.118308 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:21:07.128458 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae039-fbd5-4b71-b34d-01d5fd9c3925 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:21:07.133049 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6e8bab40c4b4f029d9ac7600d756797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:21:07.133692 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:21:07.133971 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:21:07.134233 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:21:07.142019 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:21:07.143454 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:21:07.152552 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1215/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:21:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:21:17.148176 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:23:13.414235 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:23:13.415784 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 07:23:13.506622 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7ff2-4772-444e-ac2c-228d12454fd2 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:23:13.512387 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91af00-28d4-4fc5-89f1-dd515a1de5fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6637a4d8b7104d158d4d9952cc2a5216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:23:13.513001 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91af00-28d4-4fc5-89f1-dd515a1de5fa service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:23:13.513278 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91af00-28d4-4fc5-89f1-dd515a1de5fa service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:23:13.513548 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91af00-28d4-4fc5-89f1-dd515a1de5fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:23:13.522338 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91af00-28d4-4fc5-89f1-dd515a1de5fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:23:13.523946 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91af00-28d4-4fc5-89f1-dd515a1de5fa service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:23:13.533886 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1222/2437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:23:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:23:23.529876 dv-cinder-834822-5-iscsi devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=37 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 07:23:47.658533 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 07:23:47.679738 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05604c-533f-41ae-ba3b-bde24ae64613 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 07:23:47.683965 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f52cb-5b69-4939-b2ee-c1a92e6eaea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4530cddbad6f4446beaf33a67135257e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '417b0c9162d04d2791a27bc718d0d5e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 07:23:47.684609 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f52cb-5b69-4939-b2ee-c1a92e6eaea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 07:23:47.684888 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f52cb-5b69-4939-b2ee-c1a92e6eaea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 07:23:47.685162 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f52cb-5b69-4939-b2ee-c1a92e6eaea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 07:23:47.694615 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f52cb-5b69-4939-b2ee-c1a92e6eaea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 07:23:47.696127 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f52cb-5b69-4939-b2ee-c1a92e6eaea0 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 07:23:47.725336 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1216/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jun 24 07:23:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 07:23:57.722913 dv-cinder-834822-5-iscsi devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=18 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}